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Abstract. We use Higgs bundles to answer the following question: When can a maximal 
Sp(4, M)-representation of a surface group be deformed to a representation which factors 
through a proper reductive subgroup of Sp(4,IR)? 



1. Introduction 

A good way to understand an object of study, as Richard Feynman famously remarke(£|, 
is to "just look at the thing". In this paper we apply Feynman's method to answer the 
following question: given a surface group representation in Sp(4, M), under what conditions 
can it be deformed to a representation which factors through a proper reductive subgroup 
of Sp(4,M)? 

A surface group representation in a group G is a homomorphism from the fundamental 
group of the surface into G. For a surface of genus g ^ 2, the moduli space of reductive 
surface group representations into G = Sp(4, R), denoted by 7^(Sp(4, R)), has 3-2'^^~^^+8g—13 
connected components (see [I71I22])- The components are partially labeled by an integer, 
known as the Toledo invariant, which ranges between 2 — 2g and 2g — 2. If TZd denotes the 
component with Toledo invariant d, then there is a homeomorphism TZd ~ TZ-d and except 
for the extremal cases (i.e. \d\ = 2g — 2) each TZd is connected. In contrast, the subspace 
of maximal representations 7^™"^ = lZ2g-2 have 3 ■ 2^^ + 2g — 4: components. These are 
our objects of study. The precise question we answer is thus: which maximal components 
contain representations that factor through reductive subgroups o/Sp(4,R)? 

One motivation for this question stems from the fundamental work of Goldman [TS| [2U] 
and Hitchin [SHj. Goldman showed that, in the case of PSL(2,R), the space of maximal 
representations coincides with Teichmiiller space, i.e., the space of Fuchsian representations. 
Using Higgs bundles, Hitchin constructed distinguished components in the moduli space 
of reductive representations in the split real form of any complex reductive group. These 
components, known as Hitchin components, have been the subject of much interest, see for 
example Burger-Iozzi-Labourie-Wienhard, [4j, Fock-Goncharov [13], Guichard-Wienhard 
[23] and Labourie [SOI ED- 

Moreover, the representations in these components factor through homomorphisms from 
SL(2,M) into the split real form. In the case of Sp(4, R) there are 2^^ Hitchin components. 
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all of which are maximal and contain representations which factor through the irreducible 
representation of SL(2, M) in Sp(4, M). One is thus led to ask whether the other 2^^"*"^ + 2(yf — 4 
components have similar factorization properties. 

In the case of Sp(4, M) there are 2^^ Hitchin components. They are projectively equivalent, 
in the sense that they project to a unique Hitchin component in the moduli space for the 
projective symplectic group PSp(4,]R). The Sp(4, R) Hitchin components are all maximal 
and all contain representations which factor through the irreducible representation of SL(2, M) 
in Sp(4,M). One is thus led to ask whether the other 2^^"'"^ + 2g — 4 maximal components 
have similar factorization properties. 

To answer our question we need a microscope with which we can "just look at" the com- 
ponents of 7^™"^. Higgs bundles provide the tool we need. A Higgs bundle is a holomorphic 
bundle together with a Higgs field, i.e. a section of a particular associated vector bundle. 
Such objects appear in the context of surface group representations as follows. Given a real 
orientable surface, say S, and any real reductive Lie group, say G, representations of iti^S) 
in G depend only on the topology of S, i.e. on its genus. Fixing a conformal structure, or 
equivalently a complex structure, transforms S into a Riemann surface (denoted by X). This 
opens the way for holomorphic techniques and brings in Higgs bundles. The group G appears 
as the structure group of the Higgs bundles, which are hence called G-Higgs bundles. By 
the non-abelian Hodge theory correspondence ([251 [TTl [391 [9l [15]), reductive representations 
of 7ri(X) in G correspond to polystable G-Higgs bundles, and the representation variety, i.e. 
the space of conjugacy classes of reductive representations, corresponds to the moduli space 
of polystable Higgs bundles. 

Taking G = Sp(4, R) we denote the moduli space of polystable Sp(4, R)-Higgs bundles by 
A^(Sp(4, R)) (or simply A4). The non-abelian Hodge theory correspondence then gives a 
homeomorphism Ai — 7^(Sp(4,R)). Let J\yl"^°-^ C be subspace corresponding to TZ^"-^ 
under this homeomorphism. If a representation in Sp(4, R) factors through a subgroup, say 
G* C Sp(4, R), then the structure group of the corresponding Sp(4, R)-Higgs bundle reduces 
to G*. Through the lens of our Higgs bundle microscope, the question we examine thus 
becomes: which components of Ai'^"'^ contain polystable SplAjWj-Higgs bundles for which 
the structure group reduces to a subgroup G^, ? This is the question we answer. 

The geometry of the hermitean symmetric space Sp(4, R)/U(2) , together with results of 
Burger, lozzi and Wienhard O [B] (see Section ^ constrain G* to be one of the following 
three subgroups 

• Gi = SL(2,R), embedded via the irreducible representation of SL(2,R) in Sp(4,R), 

• Gp, the normalizer of the product representation 

Pp : SL(2,R) X SL(2,R) — > Sp(4,R) , 

• Ga, the normalizer of the composition of Pp with the diagonal embedding of SL(2, R) 
in SL(2,R) x SL(2,R). 

For each possible G=k we analyze what G*-Higgs bundles look like and then, following 
Feynman's dictum, we simply check to see which components of ^Vf™-'^^ contain Higgs bundles 
of the required type. In practice this means that we carefully describe the structure of 
maximal Sp(4, R)-Higgs bundles and compare it to that of the G*-Higgs bundles. 

Our results for each of the possible subgroups are given by Theorems 16.171 17.121 and 18.161 
These lead to our main result. Theorem 15.31 whose essential point is the following. 
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Theorem 1.1. Of the 3 ■ 2^^ + 2(7 — 4 components of M'^'^^ 

(1) 2^^ are Hitchin components in which the corresponding Higgs bundles deform to max- 
imal SL{2, M.)-Higgs bundles, 

(2) 2 ■ 2^^ — 1 components have the property that the corresponding Higgs bundles deform 
to Higgs bundles which admit a reduction of structure group to Gp, and also deform to ones 
which admit a reduction of structure group to G^, and 

(3) 2g — 3 components have the property that the corresponding Higgs bundles do not admit 
a reduction of structure group to a proper reductive subgroup o/Sp(4,M). 

The corresponding resuh for surface group representations, given in Theorem 15.41 says the 
following: 

Theorem 1.2. Of the 3 ■ 2^5 + 2^ - 4 components of 7^'""^• 

(1) 2^^ are Hitchin components, i.e. the corresponding representations deform to ones 
which factor through (Fuchsian) representations into SL(2,R), 

(2) 2- 2^^ — 1 components have the property that the corresponding representations deform 
to ones which factor through Gp, and also deform to ones which factor through Ga, and 

(3) 2g — 3 components have the property that the corresponding representations do not 
factor through any proper reductive subgroup o/Sp(4, M). 

In fact part (1) of Theorems 11.11 and 1 1 . 21 follows from Hitchin's general construction in [26\ . 
It is nevertheless instructive to see the explicit details of the construction in our particular 
case, namely G = Sp(4,M), and to view the results from a new perspective. The results 
about the other maximal components and the other possible subgroups are new. They raise 
the interesting problem of gaining a better understanding of the representations which do 
not deform to representations which factor through a proper reductive subgroup of Sp(4, 

In addition to the main results in Theorems 11.11 and II. 2[ we also give (in Section 13.71) 
explicit descriptions of some of the components. Together with the main theorems, these 
have consequences whose import goes beyond the specific case of G = Sp(4,Mfl In particular 
the 2g — 3 components where representations do not factor through any reductive subgroup 
are remarkable for the following reasons: 

• the representations in these components all have Zariski dense image in Sp(4, M). 

• the components are smooth but, unlike the Hitchin components, topologically non- 
trivial. 

The group G = Sp(4,M) is thus an example of a Lie group with rank greater than 1 for 
which the moduli space of surface group representations into G has components with these 
properties. To the best of our knowledge this is the first such example. Furthermore, by 
results of Labourie ([30]) and Wienhard ([Mj), the mapping class group is known to act 
properly discontinuously on TV^""^ . The components we describe thus give examples of non- 
trivial manifolds which carry such actions of the mapping class group. 

We note, finally, that the case G = Sp(4, M) has features not shared by Sp(2r;,, M) for n > 2. 
In particular, the moduli space of representations (or Higgs bundles) has anomalously large 
number of connected components when n = 2, compared to the case n ^ 3. Moreover, we 
prove in Corollary 19.41 that, when n ^ 3, there are no components of TZ"^"-^ in which all 

^ The recent preprint |24j takes interesting steps in this direction. 
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representations have Zariski dense image. The case n = 2 thus demands treatment as a 
special case. 
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2. Basic background on Higgs bundles and representations 

2.1. Higgs bundles. Our main tool for exploring surface group representations is the rela- 
tion between such representations and Higgs bundles. We are interested primarily in repre- 
sentations in Sp(4, M), but it is useful to state the general definition. 

Let G be a real reductive Lie group. Following Knapp [271 P- 384], by this we mean 
that we are given the data (G, H, 6, B), where if C G is a maximal compact subgroup (cf. 
[271 Proposition 7.19(a)]), 6: g — )■ g is a Cartan involution and 5 is a non-degenerate bilinear 
form on g, which is Ad(G)-invariant and 6'-invariant. The data (G, H, 6, B) has to satisfy in 
addition that 

• the Lie algebra g of G is reductive 

• gives a decomposition (the Cartan decomposition) 

g = P) © m 

into its ±l-eigenspaces, where f) is the Lie algebras of if, 

• f) and m are orthogonal under _B, and B is positive definite on m and negative definite 
on f), 

• multiplication as a map from H x exp m into G is an onto diffeomorphism. 
We will refer sometimes to the data (G, H, 6, B), as the Cartan data. 

Remark 2.1. If G is semisimple, the data (G, H, 6, B) can be recoverecfl from the choice of a 
maximal compact subgroup H <Z G. There are other situations where less information does 
the job, e.g. for certain linear groups (see [271 P- 385]). 

Remark 2.2. The bilinear form B does not play any role in the definition of G-Higgs bundle 
that follows but it is essential for defining the stability condition and for making sense of the 
Hitchin-Kobayashi correspondence. 

Remark 2.3. Note that the compactness of H together with the last property above say that 
G has only finitely many components. Note also that we are not assuming, like Knapp, that 
every automorphism P^d{g) of g"-" is inner for every g E G. 

Let and f)"' be the complexifications of g and f) respectively, and let H'^ be the com- 
plexification of H. Let 

gC^f^Cg^^C ^2.1) 



^To be precise, the quadratic form B can only recovered up to a scalar but this will be sufficient for 
everything we do in this paper. 



be the complexification of the Cartan decomposition. The adjoint action of G on g restricts 
to give a representation - the isotropy representation - of if on m. Since any two Cartan 
decompositions of G are related by a conjugation, the isotropy representation is independent 
of the choice of Cartan decomposition. The same is true of the complexification of this 
representation, allowing us to define: 

Definition 2.4. A G-Higgs bundle over X is a pair {E, ip) where 

• E is a principal holomorphic H'^ -bundle E over X and 

• if is a holomorphic section of E{m^) ®K, where E{vi\F') is the bundle associated to 
E via the isotropy representation of H'^ in xn^ and K is the canonical bundle on X. 

Remark 2.5. If G = Sp(4,M) then H = U(2) and = GL(2,C). It is often convenient to 
replace the principal GL(2, C)-bundle in Definition 12.41 with the vector bundle associated to 
it by the standard representation. In the next sections we denote this vector bundle by V. 

In order to define a moduli space of G-Higgs bundles we need a notion of stability. We 
briefly recall here the main definitions (see [151 [16] fo^' details). Let f)^ be the semisimple part 
of ()"', that is, ()^ = [f)^, i)^]. Choosing a Cartan subalgebra, let A be a fundamental system 
of roots of f)^. For every subset A C A there is a corresponding parabolic subalgebra pA of P)^ 
and all parabolic subalgebras can be obtained in this way. Denote by Pa the corresponding 
parabolic subgroup of H'^. Let x be an antidominant character of pA- Using the invariant 
form on f) defined hj B, x defines an element G ii). Now for s G if), define the sets 

Ps = {x e i)'^ : Ad(e*'')x is bounded as t -> oo} 

Ps = {g e H'^ : e^'ge~^' is bounded as t oo} 

I. = {x G fi^ : [x, s] = 0} 

Ls = {geH'' : Ad{g){s) = s}. 

One has (see [TB]) that for s G if), is a parabolic subalgebra of f)"^, Pg is a parabolic 
subgroup of H'^ and the Lie algebra of is ps, Is is a Levi subalgebra of p^ and Ls is a Levi 
subgroup of Ps with Lie algebra t^. Moreover, if x is an antidominant character of pA, then 
pA ^ psy and La C Ls and, if x is strictly antidominant, pA = ps and Ia = isy 



Let L : if — )■ GL(m ) be the isotropy representation. We define 



m = {v e : L{e^'^^)v is bounded as t — oo} 



X 

m° = {-u G m*^ : i(e*'''^)t; = v for every t}. 
One has that m~ is invariant under the action of P^^ and m° is invariant under the action 

A. A 

of Ls ■ 

Let be a principal ii'^-bundle and A C A. Let a denote a reduction of the structure 
group of to a standard parabolic subgroup Pa and let x be an antidominant character of 
pA- Associated to this, there is a number called the degree of E with respect to a and x 
that we denote by deg(£')(cr, x)- If X lifts to a character of Pa, deg(i?)((j, x) is the degree of 
the line bundle associated to E„ via the lift. 

A G-Higgs bundle {E, ip) is called semistable if for any choice of P^, Xi ^ as above such 
that p G ii°(X, E„(y^^) (g) i^), we have 

degE(a,x) ^0. 
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The Higgs bundle {E, ip) is called stable if it is semistable and for any Pa-, x ^"^^ ^ ^-s above 
such that if) G E^{X, ^<x(m-) ® K) and A 7^ 0, 

degE(a,x) > 0. 

The Higgs bundle (/?) is called polystable if it is semistable and for each P^, a and x 
as in the definition of semistable G-Higgs bundle such that degi?(cr, x) = 0, there exists a 
holomorphic reduction of the structure group of E„ to the Levi subgroup of Pa, ^ 
V{Ea{PAl La)). Moreover, in this case, we require f> G £'(m°) ® K). 

We define the moduli space of polystable G-Higgs bundles A4{G) as the set of iso- 
morphism classes of polystable G-Higgs bundles. The moduli space Ai (G) has the structure 
of a complex analytic variety. This can be seen by the standard slice method (see, e.g., 
Kobayashi [28j). Geometric Invariant Theory constructions are available in the literature for 
G compact algebraic (Ramanathan [SSIES]) and for G complex reductive algebraic (Simpson 
[m 112] )• The case of a real form of a complex reductive algebraic Lie group follows from 
the general constructions of Schmitt [3B]- We thus have that Ai{G) is a complex analytic 
variety, which is algebraic when G is algebraic. 

2.2. Relation to surface group representations. Let G be a reductive real Lie group. 
By a representation of tti{X) in G we understand a homomorphism p: vri(X) — )■ G. The 
set of all such homomorphisms, Hom(7ri(X), G), is a real analytic variety, which is algebraic 
if G is algebraic. The group G acts on Hom(7ri(X), G) by conjugation: 

{9 ■ p){l) = 9p{l)9'^ 

for g E G, p E Hom(7ri(X), G) and 7 G 7ri(X). If we restrict the action to the subspace 
}lom^{TTi[X), g) consisting of reductive representations, the orbit space is Hausdorff. By a 
reductive representation we mean one that, composed with the adjoint representation in 
the Lie algebra of G, decomposes as a sum of irreducible representations. If G is algebraic 
this is equivalent to the Zariski closure of the image of 7ii{X) in G being a reductive group. 
(When G is compact every representation is reductive.) The moduli space of representations 
of vri(X) in G is defined to be the orbit space 

7^(G) = Hom+(7ri(X), G)/G. 

It has the structure of a real analytic variety (see e.g. [19]) which is algebraic if G is algebraic 
and is a complex variety if G is complex. 

To see the relation between Higgs bundles and representations of tti{X), let h he a re- 
duction of structure group of E^c from to H, and let E^ be the principal if-bundle 
defined by h. Let dh denote the unique connection on Ej^c compatible with h and let E^ 
be its curvature. If r denotes the compact conjugation of we can formulate the Hitchin 
equation 

F^-[y.,r(¥;)] = 0. 

A fundamental result of Higgs bundle theory (see [251 ESI US]) is that a G-Higgs bundle 
admits a solution to Hitchin's equation if and only if the Higgs bundle is polystable. 
Now if the Hitchin equation is satisfied then 

D = dh + ip- T{ip) 

defines a flat connection on the principal G-bundle Eq = Eh Xh G. The holonomy of this 
connection thus defines a representation of iTiiX) in G. A fundamental theorem of Corlette 
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[9] (and Donaldson [TT] for G = SL(2,C); see also Labourie [29] for a more general set-up) 
says that this representations is reductive, and that all reductive representations of vri(X) 
in G arise in this way. 

For semisimple groups the above results establish a homeomorphism between isomorphism 
classes of polystable G-Higgs bundles and conjugacy classes of reductive surface group rep- 
resentations in G, i.e. 

7W(G)~7^(G). (2.2) 

It is this homeomorphism that allows us to use Higgs bundles to study surface group repre- 
sentations. If G is reductive (but not semisimple) there is a similar correspondence involving 
representations of a universal central extension of the fundamental group. 

2.3. Reduction of structure group. Let G be a real reductive Lie group as defined in 
Section 12.11 Our main concern is to understand when a surface group representation in G 
factors through a subgroup of G. In this section we reformulate in terms of Higgs bundles 
what it means for the representation to factor through a subgroup. 

A reductive subgroup of G is a reductive group, say {G', H', 6', B'), such that the Cartan 
data is compatible in the obvious sense with the Cartan data of {G, H, 6, B) under the 
inclusion map G' ^ G. In particular this implies that H' <Z H and we have a commutative 
diagram 

] ] (2.3) 

Moreover, the embedding of isotropy representations m'^ )■ m*^ is equivariant with respect 
to the embedding H'^ H'^. 

Definition 2.6. Let G he a real reductive Lie group and let G' G G be a reductive subgroup. 
Let (E, if) be a G-Higgs bundle. A reduction of (i?, y)) to a G'-Higgs bundle {E\ Lp') is 
given by the following data: 

(1) A holomorphic reduction of structure group of E to a principal H''^ -bundle E' ^ E 
(equivalently, this is given by a holomorphic section a of E/H' X). 

(2) A holomorphic section (p' of E'{m'^) K which maps to (p under the embedding 

E'{m'^)®K^ E{m^)®K. 

We have the following. 

Proposition 2.7. Let G be a real reductive Lie group and let G' G G be a reductive subgroup. 
Let (Ehc,^) be a G-Higgs bundle whose structure group reduces to G' . Let {EH^,ip') be the 
corresponding G' -Higgs bundle. If {Ehc,'^) is polystable as a G-Higgs bundle, then {Eu'^^ip') 
is polystable as a G' -Higgs bundle. 

The key fact in the proof of Proposition 12.71 is that every parabolic subgroup of and 
a character of its Lie algebra extend to a parabolic subgroup of and a character of its 
corresponding Lie algebra. Moreover, the corresponding degrees for parabolic reductions of 
structure group of the bundles coincide. This can be seen using filtrations of the vector 
bundles associated to E^c and E^ic via an auxiliary representations of H'^ (see [16j). 
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In the situation of Proposition \2.7\ the non-abehan Hodge theory correspondence imphes 
that the polystable G'-Higgs bundles obtained from polystable G-Higgs bundles correspond 
to ^'-representations of vri(X). Conversely, let p be a reductive surface group representation 
in G which factors through a reductive subgroup G'. Then it is clear that the corresponding 
polystable G'-Higgs bundle is a G'-reduction of the G-Higgs bundle corresponding to p. Thus 
Proposition 12.71 has the following immediate corollary. 

Proposition 2.8. Let G be a real reductive Lie group and let G' G G be a reductive subgroup. 

(1) A reductive ni{X) -representation in G factors through a reductive representation in 
G' if and only if the corresponding polystable G-Higgs bundle admits a reduction of structure 
group to G' . 

(2) Let p : tti{X) — y G be a reductive representation and let {Effc, ip) be the corresponding 
polystable G-Higgs bundle. Suppose that {Euc^ip) defines a point in a connected component 
A^c(G) C M.{G). The representation p deforms to a representation which factors through 
G' if and only if M.^{G) contains a point represented by a G-Higgs bundle that admits a 
reduction of structure group to G' . 

Let G be a real reductive Lie group and let G' t- G be an embedding of the Lie group G' 
as a closed subgroup. One may ask whether the Cartan data of G induces Cartan data on 
G' such that G' is a reductive subgroup of G. In the following we answer this question. 

Definition 2.9. An embedding of Lie algebras g' C canonical with respect to a Cartan 
involution, 9, on g if 9{q') = g'. 

Lemma 2.10. Let G' G G be a closed Lie subgroup such that q' G Q is canonically embedded. 
Then H' = H (1 G' is a maximal compact subgroup of G' . Moreover, if we let 6' and B' be 
the restrictions of 9 and B, respectively, to g', then {G' , H' , 9' , B') is a reductive subgroup of 



In view of this Lemma, we make the following convention. 

Convention. Whenever G' C G is a closed subgroup whose Lie algebra is canonically 
embedded, we consider G' as a reductive subgroup of G with the induced Cartan data. 

Remark 2.11. If, in the situation of Lemma [2. 101 G' is semisimple, the structure of reductive 
subgroup induced from G must coincide with the one coming from the choice of the maximal 
compact subgroup H' = H H G' (cf. Remark [2.ip . 

Thus, if we are given a semisimple closed subgroup G' G G with an a priori choice of 
maximal compact H' G G', then in order to check that the corresponding Cartan data 
coincides with the Cartan data induced from G, it suffices to check that H' = H n G and 
that g' is canonically embedded. 



3.1. Definition of Sp(4,]R) and choice of Cartan data. The Lie group Sp(4,]R) is the 
subgroup of SL(4, M) which preserves a symplectic form on M^. The description of the group 
depends on the choice of symplectic form. We use the following conventions. 

Definition 3.1. Let 



{G,H,9,B). 



3. Sp(4,]R)-HlGGS BUNDLES 




(3.1) 
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where I2 is the 2x2 identity matrix. This defines the symplectic form uis{a,b) = a^Ji^b 
where a and b are vectors in Mf^, i.e. 

^13 = a^i A + 0:2 A X4. (3.2) 

The symplectic group in dimension four, defined using J13, is thus 

Sp(4, R) = {ge SL(4, M) | g'j.^g = J13 }■ (3.3) 

Remark 3.2. Later on (see Sections 14.11 18. ip it will be convenient to consider other choices 
of symplectic form (denoted by J12 and Jo). The resulting changes in description will be 
pointed out as needed. 

The maximal compact subgroups of Sp(4,M) are isomorphic to U(2), i.e. in the notation of 
the previous section, if G = Sp(4, M) then H = U(2). Using symplectic form J13, we fix the 
subgroup U(2) C Sp(4,M) given by 

U(2) = I (^^^ ^ I A' A + B'B = I , A'B-B'A = 0^ , (3.4) 

i.e. given by the embedding 

A+^E^M (3.5) 



^ -B AJ ■ 

It follows from (13. 3 p and (13. 5 p that the Cartan decomposition corresponding to our choice 
of U(2) is defined by the involution 

e{X) = -X' (3.6) 

on 

sp(4, M) = I \A,B,Ce Mat2(M) ; B' = B , C* = C } . (3.7) 



This gives 
with 



sp(4,M) = u(2) ©m (3.8) 

u(2) =1 (^^^ ^ \A,Be Mat2(M) ; A' = -A , B' = B ^ , (3.9) 
^ \A,Be Mat2(M) ; A* = A , 5* = 5 I . (3.10) 



A B 

B -A. 



The complexification of (13. 8p . 

sp(4,C) =gl(2,C) ©m^ (3.11) 
is obtained by replacing Mat2(IR) with Mat2(C). In particular, we identify qI{2, C) via|l 



( 









0[(2,C) = { ^ \ A,B eMat2{C) ; A' = -A,B' = B} (3.12) 



This corresponds to mapping 

C z-z* z+z^ 

2 2i 

z+z* z-z* 

1i 2 , 



Notice that after conjugation by T = ^^^^ , i.e. after the change of basis (on C^) 

effected by T, we identify the summands in the Cartan decomposition of sp(4, C) C s[(4, C) 



as 



0[(2,C)={(^Q |ZGMat2(C)} 








(o 













= Sym^(C') © Sym'((C')*) . (3.13) 

This corresponds to an embedding of U(2) (the maximal compact subgroup of Sp(4, R)) in 
SU(4) (the maximal compact subgroup in SL(4,C)) given by 

^ ^ (o (f/°)-0 ^^^""''^ U*U = I . (3.14) 

3.2. Definition of Sp(4, M)-Higgs bundles. We fix G = Sp(4,M) and H = U(2) as in 
Section [3.11 Given a holomorphic principal GL(2, C)-bundle on X, say E, let V denote 
the rank 2 vector bundle associated to E by the standard representation. The Cartan 
decomposition described in Section [3TT] shows (see (13.131) ) that we can identify 

E{nf) = Sjm\V) © Sjm\V*). (3.15) 

Definition (12.41) thus specializes to the following: 

Definition 3.3. With G = Sp(4,M) and H = U(2) as in SecUon{3Ji an Sp(4, M)-Higgs 
bundle over X is defined by a triple (V, /3, 7) consisting of a rank 2 holomorphic vector 
bundles V and symmetric homomorphisms 

(5:V* — >V®K and 7 : ^ — >V* ®K. 

Except when it is important to keep track of the maximal compact subgroup, we will refer 
to these objects as Sp(4, ]R)-Higgs bundles. The composite embedding 

Sp(4, M) ^ Sp(4, C) ^ SL(4, C) (3.16) 

allows us to reinterpret the defining data for Sp(4, M)-Higgs bundles as data for special 
SL(4, C)-Higgs bundles (in the original sense of [26]). Indeed, the embeddings fl3.13p show 
that the triple (V,/3,7) in Definition 13.31 is equivalent to the pair (<£^,v?), where 

(1) £^ is the rank 4 holomorphic bundle £ = V ®V* , and 

(2) y9 is a Higgs field ip : £ — > £ ® K given hy (p = ( ° ) • 

Remark 3.4. The definition of Sp(2n, M)-Higgs bundles for general n is of course entirely 
analogous and later we shall need the special case n = 1, corresponding to G = Sp(2, M) = 
SL(2,M). Thus an SL(2, M)-Higgs bundle is given by the data (L,/3,7), where L is a line 
bundle, /3 G H^{L^K) and 7 G H^{L~^K). 
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3.3. Stability. The general definition of (semi-)stability for G-Higgs bundles given in Sec- 
tion [2?T] simplifies in the case G = Sp(2n, M) (see [151 Section 3] or [38] )• To state the 
simplified stability condition, we use the following notation. For any line subbundle L G V 
we denote by L-*- the subbundle of V* in the kernel of the projection onto L*, i.e. 

— > — >V* — > L* — ^ . (3.17) 

Moreover, for subbundles Li and L2 of a vector bundle V, we denote by Li ®5 L2 the sym- 
metrized tensor product, i.e. the symmetric part of Li (g) L2 inside the symmetric product 
5*^^^ (these bundles can be constructed in standard fashion from the corresponding repre- 
sentations, using principal bundles). For n = 2, i.e. for G = Sp(4, M), the stability condition 
then takes the following form. 

Proposition 3.5. An S]i{A,M.)-Higgs bundle (V,/3,7) is semistable if and only if all the 
following conditions hold 

(1) = then deg{V) ^ 0. 

(2) 7/7 = then deg{V) ^ 0. 

(3) Let L G V be a line subbundle. 

(a) If/3e H^{L ®sV^K) and 7 G H^L^ ®s V* K) then deg(L) ^ 

(b) 7/7 G H\{L^f ® K) then deg(L) ^ 0. 

(c) 7//3 G 770(L2 ® K) then deg(L) ^ deg(V"). 

If, additionally, strict inequalities hold in then (V, /3, 7) is stable. 

Similarly, the notion of polystability simplifies as follows. 

Proposition 3.6. Let (V, /3, 7) be an Sp(4, R)-Higgs bundle with deg{V) ^ 0. Then {V, /3, 7) 
is polystable if it is either stable, or if there is a decomposition V = Li® L2 ofV as a direct 
sum of line bundles, such that one of the following conditions is satisfied: 

(1) The Higgs fields satisfy /3 = f3i + (32 and 7 = 7i + 72; where 

Pi G 77° (42 ® K) and G 77° (Lr^ ® K) 

fori = 1,2. Furthermore, the Sp{2,'R)- Higgs bundles {Li,l3i,'yi) are stable fori = 1,2 
and there is an isomorphism of Sp{2, M)-Higgs bundles {Li,f3i,ji) ^ (7^2, /325 72)- 

(2) The Higgs fields satisfy 

' 13 eH\{LiL2®L2L{)®K) 

Furthermore, deg(Li) = deg(L2) = deg(V)/2 and the rank 2 Higgs bundle {Li © 
L*,(;^)) zs stable. 

Remark 3.7. If degV = then there are other possible decompositions for a polystable 
Sp(4, M)-Higgs bundle; and if (V,/3,7) is as in (1) of Proposition 13.61 but with (Li,/3i,7i) 
and (L2, /32, 72) non isomorphic then it is a stable Sp(4, R)-Higgs bundle which is not simple 
(see Theorem 3.40 in [15] for details). 

The following result [15] relating polystability of Sp(4, M)-Higgs bundles to polystability of 
GL(4, C)-Higgs bundles is useful. It is important to point out that, though the polystability 
conditions coincide, the stability condition for a Sp(4, ]R)-Higgs bundle is weaker than the 
stability condition for the corresponding GL(4, C)-IIiggs bundle. 
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Proposition 3.8 ([151 Theorem 5.13]). An Sp{4:,M.)-Higgs bundle (V,/3,7) is polystable if 
and only if the GL{4:,C)-Higgs bundle {V (BV*,(p = (° o)) ^■^ polystable. 

Recall that a GL(4, C)-Higgs bundle {£, ip) is stable if, for any proper non-zero yj-invariant 
subbundle F C S satisfies Ai(-F) < /^(i^), where fi{F) = deg(F)/ rk(F) is the slope of the 
subbundle. The Higgs bundle {S, ip) is polystable if it is the direct sum of stable Higgs 
bundles, all of the same slope. Moreover, to check that the GL(4, C)-Higgs bundle {S = 
V (BV* , (fi = (^^^ q)) is stable, it suffices to consider (^-invariant subbundles which respect the 
decomposition £ = V ®V* (see [2]). 

Remark 3.9. Similarly, the stability condition for an SL(2, M)-Higgs bundle (L, (3, 7) simplifies 
as follows. 

(1) If deg(L) > then (L,/3,7) is stable if and only if 7 7^ 0. 

(2) If deg(L) < then (L, /3, 7) is stable if and only if 7^ 0. 

(3) If deg(L) = then (L, /3, 7) is polystable if and only if either /3 = = 7 or both (3 
and 7 are nonzero. 

Moreover, if deg(L) 7^ 0, then stability, polystability and semistability are equivalent con- 
ditions. Notice that from the semistability condition if deg(L) > 0, since 7 7^ 0, we must 
have that deg(L) ^ g — 1; and similarly, if deg(L) < 0, since /3 7^ 0, we must have that 
deg(L) ^ 1 — g. We thus have the Milnor-Wood inequality for SL(2, M)-Higgs bundles (see 
[3211201 [25]). 

Finally, in a manner analogous to Proposition 13. 8[ we have that (L, /3, 7) is a polystable 
SL(2, M)-Higgs bundle if and only if 

is a polystable SL(2, C)-Higgs bundle. 

3.4. Toledo invariant and moduli spaces. The basic topological invariant of an Sp(4, M)- 
Higgs bundle is the degree of V. 

Definition 3.10. The Toledo invariant of the Sp(4, M.)-Higgs bundle (V, 7, /3) is the integer 

d = deg{V). 

From the point of view of representations of the fundamental group, the Toledo invariant is 
defined for representations into any group G of hermitean type. This justifies the terminology 
used in the definition. 

The following inequality for the Toledo invariant has a long history, going back to Milnor 
[32], Wood [S], Dupont P], Turaev [13], Domic-Toledo [lU] and Clerc-0rsted [S]. It is 
usually known as the Milnor-Wood inequality. 

Proposition 3.11. Let {V,P,'y) be a semistable SplAjM.)- Higgs bundle. Then 

\d\^2g-2. 

□ 

The sharp bound for G = Sp(4,]R) was given by Turaev. In its most general form the 
Milnor-Wood inequality has been proved by Burger, lozzi and Wienhard. For a proof in the 
present context of Higgs bundle theory, see [22] . 
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We call Sp(4, M)-Higgs bundles with Toledo invariant d = 2g — 2 maximal, and define 
maximal representations p: vri(X) — )■ Sp(4, M) similarly. 
For simplicity, we shall henceforth use the notation 

for the moduli space parametrizing isomorphism classes of polystable Sp(4, M)-Higgs bundles 
(V,/3,7) with deg(^) = d. We will denote the components with maximal positive Toledo 
invariant by A^"^"^, i.e. 

We remark (cf. [I5]) that there is an isomorphism Aid ^ Ai-d-, given by the map (V, /3, 7) — t- 
(\^*,7,/3). This justifies restricting attention to the case d ^ of positive Toledo invariant . 

3.5. Maximal Sp(4, M)-Higgs bundles and Cayley partners. The Higgs bundle proof 
[22] of Proposition 13.111 has the following important consequence. 

Proposition 3.12. Let (V,/3,7) he a polystable Sp{A,'R.)-Higgs bundle. If degV = 2g — 2, 
i.e. if d is maximal and positive, then 

is an isomorphism. 

If 7 : y — y V* ® K is an isomorphism, then some of the conditions in Proposition 13.51 
cannot occur. The stability condition then reduces to: 

Proposition 3.13. Let (V,/3,7) be an Sp{4,M.) -Higgs bundle and assume that 7: — t- 
V* ® K is an isomorphism. Set 

/3 = (/3(g) 1)07: (3.18) 

Then (V, /3, 7) is semi-stable if and only if for any line subbundle L G V isotropic with respect 
to 7 and such that P{L) C L (g) K^, the following condition is satisfied 

/x(L) ^ piV) . 

If strict inequality holds then (V,/3,7) is stable. 

If we fix a square root of K, i.e. if we pick a line bundle Lq such that Lq = K, and define 

W = V*®Lo (3.19) 

then it follows from Proposition 13.121 that the map 

-=^0 :W* (3.20) 

defines a symmetric, non-degenerate form on W, i.e. {W, qw) is an 0(2, C)-holomorphic bun- 
dle. The remaining part of the Higgs field, i.e. the map /3 defines a i^^-twisted endomorphism 

e = i^^ Ik^l,) o{I3®Il,):W ®KK (3.21) 

The map 9 is gpi/-symmetric, i.e. it takes values in the isotropy representation for GL(2,]R). 
The pair {W,qw,6) thus satisfies the definition of a G-Higgs bundle with G = GL(2,M), 
except for the fact that the Higgs field 9 takes values in E(m^)'^K'^ instead of in E{m^)'^K. 
We say that {W, 9) defines a i^^-twisted Higgs pair with structure group GL(2, M) (see 
[in] for more details). 
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Definition 3.14. We call (W,qw,0) the Cayley partner of the Sp{4:,'R)-Higgs bundle 
(V^,/3,7). 

The original Sp(4, M)-Higgs bundle can clearly be recovered from the defining data for its 
Cayley partner. We refer to j3] for more details on this construction, including an exposition 
of the general framework which justifies our terminology. Occasionally, when the section 6 
is not directly relevant for our considerations, we shall also refer to the orthogonal bundle 
{W, qw) as the Cayley partner of (V, (3, 7). 

The following Proposition sums up the essential point of the constructions of this section. 

Proposition 3.15. Let (V,/3,7) be a polystable SplAjM^j-Higgs bundle with maximal positive 
Toledo invariant, i.e. with deg{V) = 2g — 2. Then V can be written as 

V = W0Lo , (3.22) 

where W is an 0{2, C)-bundle and Lq is a line bundle such that 

Ll = K . (3.23) 

Also, the isomorphism 7 is given by 

^ = q®lL,:W ®Lo—^W* ®Lo , (3.24) 

where q defines the orthogonal structure on W and II^ is the identity map on Lq, and 

det{Vy = . (3.25) 

3.6. Connected components of the moduli space. The moduli space M."^""^ of max- 
imal Sp(4, ]R)-Higgs bundles is not connected. Its connected components of M.'^'^^ were 
determined in [22j. In contrast, each moduli space }Ad for \d\ < 2g — 2 is connected (see 
[T7]). In this section we explain the count of components of and identify the Higgs 

bundles appearing in each component. 

The key to the count of the components of 71^™"^' is Proposition 13.121 The fact that the 
orthogonal bundle {W,qw) underlying the Cayley partner is an 0(2, C)-bundle reveals new 
topological invariants, namely the first and second Stiefel- Whitney classes 

WiiW, qw) e H\X- Z/2) ~ 'L/2'^3 (3.26) 

W2{W, qw) e H^{X- Z/2) ~ Z/2 . (3.27) 

Rank 2 orthogonal bundles were classified by Mumford in [S^ (though the reducible case 
(3) was omitted there): 

Proposition 3.16. A rank 2 orthogonal bundle {W,qw) is one of the following: 

{1) W = L ® L^^ , where L is a line bundle on X, and qw = (lo)- In this case 
Wi{W,qw) = 0.^ 

(2) W = n^:{L^L*L~^) where n : X — > X is a connected double cover, L is a line bundle 
on X , and t : X — y X is the covering involution. The quadratic form is locally of 
the form qw = (? o)- In this case Wi{W,qw) G H^{X;Z/2) is the non-zero element 
defining the double cover. 

(3) W = Li (B L2 where Li and L2 are line bundles on X satisfying Lf = Ox, and 
Qw = Qi + Q2 where qi defines the isomorphism Li ~ L^-^ . In this case Wi{W,qw) = 
Wi{Li,qi) +Wi{L2,q2)- 
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Note that cases (1) and (3) above are not mutually exclusive: they coincide when V = L®L 
with L'^ = aJldqw = {ll)■ 
Remark 3.17. In case (2) above, the line bundles of the form M = L® l*L~^ constitute the 
kernel of 1 + : Jac(X) — t- Jac(X). Moreover, this kernel consists of two components 
and P~ (distinguished by the degree of L modulo 2), each one of them a translate of the 
Prym variety of the cover (cf. [M])- It can be shown that the value of W2{W,qw) is or 1 
depending on whether M belongs to or P (see [221 Proposition 5.14]). 

Recall that the first Stiefel- Whitney class is the obstruction to the existence of a reduction 
of structure group to S0(2,C) C 0(2, C). Thus, with S0(2,C) ~ C* via A ^ ( ^ ) , we 
get: 

Proposition 3.18. Let (W,qw) be an O {2, C) -bundle. Then wi(W,qw) equals zero if and 
only if {W,qw) is of the kind described in (1) of Proposition \3.16i In this case the second 
Stiefel-Whitney class, W2{W,qw), lifts to the integer class ci(L) G H'^{X;Z). 

Let (V, /3,7) be a maximal semistable Sp(4, R)-Higgs bundle and let {W,qw) be defined 
by fl3.19p and (13.201) . We define topological invariants of (V,/3,7) as follows: 

Wi{V,/3,-f) =Wi{W,qw), i = l,2. 

Note that these invariants are well defined because the Stiefel-Whitney classes are indepen- 
dent of the choice of the square root Lq of the canonical bundle used to define the Cayley 
partner {W,qw)- When wi{V,(3,'y) = 0, the class W2iV,(3,'j) lifts to the integer invariant 
deg(L), where W = L Q) = V ^ Lq ^ is the vector bundle underlying the Cayley partner 
of (V^,/3,7). 

Proposition 3.19. Let (V, /3, 7) be a maximal semistable Sp(4, Wj-Higgs bundle with Wi{V, /3, 7) = 
and let {W = L® L~^,qw = (10)) be its Cayley partner. Then there is a line bundle N 
such that 

V = N® N-^K, 
and, with respect to this decomposition, 

7 = (oi)e/fO(5V*®K) and (5 = {%%) H\S^V ® K). 

The degree of N is given by 

deg(Ar) = deg(L) + (7- 1. 

Moreover, 

^ deg(L) ^2^-2 

and, for deg(L) > 0, 

When deg(L) = 2g — 2 the line bundle N satisfies 

= K^. (3.28) 

Proof. The statement about the shape of {V, /3, 7) follows by applying Propositions 13. 161 and 
13. 181 to the Cayley partner, letting = LLq. 

Assuming without loss of generality that deg(L) ^ 0, the fact that 7^ /32 G H^{X, N~'^K^) 
follows easily from semistability (cf. [22] )• The rest now follows from (\eg{N~'^K^) ^0. □ 
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It follows from fl3.28p that is determined by a choice of a square root of the canonical 
bundle K, thus revealing a new discrete invariant of a maximal semistable Sp(4, ]R)-Higgs 
bundle with wi = and deg{L) = 2g — 2. We introduce subspaces of ^Vf™"^ as follows: 

Definition 3.20. 

(1) For {wuW2) G H'^{X,Z/2) x H\X,Z/2) \ (0,0) ~ ((Z/2)^^ - {0}) x Z/2, define 

M^„^, = {{V, (3, 7) I Wi{V, /3, 7) = w,, W2{V, (3, 7) = W2}/ ~, (3.29) 

where the notation indicates isomorphism classes of Sp{4:,M.)-Higgs bundles (V, /3,7). 

(2) For c e H'^iX, Z) ~ Z with ^ c ^ 2^ - 2, define 

A^c = {(^,/3,7) I w,{V,f3,j) = 0, deg(L) = c}/ ~ (3.30) 

where {W = L® L~^,qw = (10)) is the Cayley partner of {V,f3,'y). 

(3) For a square root K^^'^ of the canonical bundle, define the following subspace o/A^2g-2 

Ml^;, = {{V = N(B N-^K, /3, 7) I AT = {K'^'^f}/ ~ . (3.31) 
In particular, we can therefore write 

Ml_, = U Ml^,, (3.32) 

where K^^'^ ranges over the 2^^ square roots of the canonical bundle. 

Remark 3.21. For the adjoint form of a split real reductive group G, Hitchin showed in 
f2U\ the existence of a distinguished component of Ai{G), isomorphic to a vector space and 
containing Teichmiiller space. This component is known as the Hitchin (or Teichmiiller) 
component. In the case of Sp(4, M), there are 2^^ such components, which are exactly the 
components A1^i/J^. These components are all projectively equivalent, in the sense that 
the restriction to each of them of the projection to the moduli space for the adjoint group 
SOo(2,3) ~ PSp(4, M) is an isomorphism onto the unique Hitchin component in this moduli 
space (cf. [3]). 

Theorem 3.22 ([22]). The subspaces Mw^^w2> -^c '"^^^^ c < 2g — 2 and are 

connected. Hence the decomposition of M.™'"'^ in its connected components is 

and the total number of connected components is 

2(229 - 1) + (2g - 2) + 2^^^ = 3 ■ 2^^^ + 2^ - 4 . 

The proof of the Theorem uses Hitchin's strategy [2S] of considering the Hitchin func- 
tion, a positive proper function on the moduli space defined by the L^-norm of the Higgs 
field. Properness of the function means that, in order to show that a given subspace M of 
the moduli space is connected, it suffices to prove connectedness of the non-empty subspace 
of local minima of the Hitchin function restricted to M . 



'hence the superscript T in the notation 
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3.7. Description of the maximal Higgs bundles. The purpose of this section is to 
describe the Higgs bundles in each connected component of _A/f'"<^^. 



Proposition 3.23. Let (V,/3,7) be an Sp{4:,R) -Higgs bundle with deg(y) = 2g -2. 

(1) Suppose that V = N(BN~^K and that with respect to this decomposition, 7 = ( ^ g ) ^ 
H%S'^V*^K), and (5= (||) eH^{S^V®K). 

(a) If g-l< deg(A^) ^ 3^-3 then: 

(i) (V,/3,7) is a stable Sp{4:,M) -Higgs bundle if and only if (32 7^ 0. 

(ii) If (32 = then (V, /3, 7) is not semistable. 

(b) Ifdeg{N)=g-l then (\/,/3,7) is: 

(i) stable if and only if (^2 and (3i 7^ 0, 

(ii) semistable if one of (32 and Pi is non-zero, 

(iii) poly stable if both (32 = and (3i = 0. 

(2) IfV = W^ K^/"^ where W is as in (2) of Proposition \3.1b\ and = qw ® ^k^/^ then 
(V,/3,7) is a stable Sp^AjM.) -Higgs bundle. 

(3) If V = {Li © L2) ® K^^"^ where Li and L2 are line bundles satisfying Lf = O, 
7 = ^'^^^jf^/^ ^^^^ j where qi gives the isomorphism Lj ~ and l^i/a denotes 

the identity map on K^/"^ , and (3 = , then 

(a) (V, /3,7) is a polystable Sp{4:,M) -Higgs bundle. 

(b) (V, /3,7) is stable if and only if Li 7^ L2. 

Moreover, if the Sp{4:,M) -Higgs bundle (y,(3,j) is stable then it is simple, unless it is of the 
form described in Case (3). 

Proof. Part (la) follows immediately from Proposition 13.131 and the bounds on deg(A^). Part 
(lb) follows from Proposition 13.61 Part (2) follows from the fact that in this case 1^ is a 
stable 0(2)-bundle. Part (3) follows from Proposition 13.61 and Remark 13.71 □ 

Remark 3.24. Proposition l3.23l (la) says that for < c ^ 2(7 — 2 all points in the components 
are represented by stable Sp(4, ]R)-Higgs bundles. These Higgs bundles are, moreover, 
simple and hence represent smooth points of the moduli space (see [16]). It follows that the 
components are smooth for all c in the range (0, 2g — 2]. 

The following Proposition gives a description of the Sp(4, M)-Higgs bundles in each com- 
ponent of A^'""^. Everything in the Proposition follows immediately from what we have said 
so far, except for the identification of the minima of the Hitchin function (which, though not 
essential, has been included for completeness; see [22] for the proofs). 

Proposition 3.25. Let [V,P,'-f] denote an isomorphism class of Sp{A,M.)- Higgs bundles in 

(1) [V,(3,'y] G if and only if we can take V = K^/"^ © K"^/^ 7 = and 
1^ = {jh 1^1/2 ) ■ represents a local minimum of the Hitchin function if and only if 
/3i = and P3 = 0. 

(2) [V, (3, 7] e with < c < 2g - 2 if and only if we can take V = N ® N~^K where 
N is a line bundle of degree c + g — 1, 7 = (ig) and (3 = (^gj ) with (32 7^ 0. It 
represents a local minimum of the Hitchin function if and only if Pi = and P^ = 0. 
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(3) [V, (3, 7] € A^o ^/ ^'^^ ^^^^2/ ^/ '"'^ ^'^'^ ^^^^ = © N~^K where N is a line bundle 
of degree g — 1 and 7 = ( ? o ) ■ It represents a local minimum of the Hitchin function 
if and only if P = 0. 

(4) [V, /3,7] G Aiwi,w2 if and only if we can take either 

(a) V = W 1^ K^^"^ where W is as in (2) of Proposition l3J^ or 

(b) V = LiK^I^ ® LiK^'^ where 

(i) Li and L2 are line bundles satisfying Lf = O , 

(ii) wi{Li) + wi{L2) = wi, wi{Li)wi{L2) = W2, and 

(iii) 7 = ( '^^q'^ ^201 ) where 1 denotes the identity map on K^^"^ and qi gives the 
isomorphism Li ~ Lj"^ . 

It represents a local minimum of the Hitchin function if and only if P = 0. 

Remark 3.26. The Sp(4, M)-Higgs bundles of the type described in case (b) of item (4) in 
Proposition 13.251 have Li 7^ L2 since Wi(Li) + 1^1 (L2) = Wi 0. We point out that Sp(4, M)- 
Higgs bundles of this form but with Li = L2 { <^==^ Wi{Li) + wi{L2) = 0) are isomorphic to 
those described in item (3) of the Proposition. 

3.8. Description of maximal components. We can use the information in Section 13.71 
to completely describe some components of ^A/f™-*^^. Points in the moduli space correspond 
to isomorphism classes of Higgs bundles, while Proposition 13.251 describes representatives of 
the isomorphism classes. We thus need to understand when two representatives belong to 
the same isomorphism class. 

For c in the range ^ c ^ 2g — 2, representatives of points in the components are 
specified, according to Proposition 13. 25[ by tuples (A^, f3i, (32, Ps) where is a line bundle of 
degree c + ^ - 1, /3i G H\N^K), P2 G H\N-^K^), and [3^ e H%K^). In the case c = 2^ - 2 



we require further that A^^ = K and that (32 = Ij 



Proposition 3.27. Fixe in the ranged < c ^ 2^1-2. Tuples {N, (3i, (32, (33) and {N' , (3[, (31., (3'^) 
define the same isomorphism class in Ai^ if and only if N = N' and 

(1) when < c < 2g - 2 

iP[,P2,(3s) = it'P,,t-'P2,P3) 

for some non-zero t G C*, while 

(2) when c = 2g — 2 

Proof. Higgs bundles (V,/3,7) and {V',(3','y') are isomorphic if and only if there is a bundle 
isomorphism g : V — > V such that 

(3' = g0lKo(3og* (3.33) 

J = g* ^ Ik o 1 o g (3.34) 

If the bundles are of the form N ® N'''^K and A^' © N'~^K, and if 7 = 7' = , then 

above constraints imply that there are two possibilities for g: either g = with g2 G 

H%N'NK-^), gs G H%iN'N)-^K) and g2g3 = 1, 01 g = (^^^^ °J with g, G H%N'N-^), 
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(^4 € H^{N' ^N) and gig^ = 1. The first possibility can occur only if A^A^' = K, i.e. if c = 0. 
Thus when < c ^ 2^1 - 2, the only possibility is that A^-^A^' = O, i.e. A^ = A^', and that 

rO (3,35) 

where t is any non-zero complex number. The result follows immediately from this. □ 
Let Jac'' be the Jacobian of degree d line bundles on X and let 

Ud — y Jac\X) X X (3.36) 

be the universal bundle. Denote the projections from Jac''(X) x X onto its factors Jac'^(X) 
and X by ttj and nx respectively. Define 

£;,'^ = njM^^xiK)) , (3.37) 
£f = TTj^iU,^ ® vri(i^')) , and (3.38) 
= Sf'^ ® ef © 7rj,(7r^(ir2)) . (3.39) 

Then Ed is a coherent sheaf over Jac'^. Moreover, for fixed c in the range 

< c < ^ - 1 (3.40) 

both h^{N'^K) and h^[N~'^K^) vanish and thus, by the Riemann-Roch theorem, h^[N'^K) 
and h^{N~'^K^) are independent of A^. It follows that Sd is locally free with fiber over the 
point represented by the line bundle A^ given by 

Sd,N = H\N^K) © H\N-^K^) © H\K^) (3.41) 
Definition 3.28. Define a -action on Sd by the fiberwise action 

C* X £d,N £d,^ (3.42) 
(t,(/3i,/32,/33)) ^ (t'/3i,r2/32,/33) (3.43) 

Proposition 3.29. 

(1) For each c in the range < c < g — 1 the component is the total space of the 
quotient Sd/C* where 

• d = c + g — 1, 

• £d denotes £d minus the zero section of Sf\ and 

• the C* action is as in Definition liS. 28\) . 

The fibers of as a fibration over 3 a.c'^ are given by (9ps(l)®'' x C^^~^ where 

r =h^{N'^K) = 2c + 3^ - 3 and (3.44) 
s=h^{N-'^K^)-l = ?,g-A-2c . (3.45) 

(2) For each choice of a square root K^/"^ of the canonical bundle, the component Ai^.^p 
is isomorphic to the vector space H^{K'^) © H^{K^). 

Remark 3.30. Part (2) of this proposition is equivalent to Hitchin's parametrization [26] of 
his Teichmiiller component (cf. Remark 13. 2ip . 
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Proof. Everything except the description of the fibers of follows immediately from Propo- 
sitions 13.251 and 13.271 The description of the fibers follows from the claim that 

(C" © (C*)^+^)/C* = Cp.(l)®'^ , 

where the C*-action is given by t{z,w) = {t'^z,t^'^w). But the total space of can 
be identified with the variety 

T = {{l,Xi, . . . , £r) \l defines a line in and afj G C'^^"'^ lies on I } 

The map 

(C © (C*)'+^)/C* ^ X © • • ■ © (3.46) 

[{Zi,. . .,Zr),w] H-> [w],{ziW,...,ZrW) (3.47) 

is well defined with a well defined inverse on the subvariety T, and thus proves our claim. 
The factor C^^'-^ comes from H^{K^). □ 

Remark 3.31. For c in the range [g — 1, 2(7 — 2], there is a map / : M.^ — )■ Jac'^"'"^"^ but it is 
not surjective and the fiber dimension is not necessarily constant. Nevertheless, by remark 
I3.24[ these components are smooth for all c in the range (0, 2g — 2\. 

4. Subgroups for maximal representations 

4.1. Identification of possible subgroups. The main result of this subsection, Proposi- 
tion U2] identifies the possible subgroups of Sp(4, M) through which a maximal representation 
can factor. The argument leading to this Proposition is due to Wienhard |44j. The basis is 
the following result of Burger, lozzi and Wienhard ^E]. 

Theorem 4.1. Let G he of hermitean type. Let p: 7ri(X) G be maximal and let G = 
(p(7ri(X))]g)° (the identity component of the real part of the Zariski closure). Then 

(1) G is hermitean of tube type; 

(2) the embedding G "-^ G is tight. 

By classification of tube type domains ([37]) one has the following. 

Lemma 4.2. The only tube type domains of dimension less than or equal to 3 and rank less 
than or equal to 2 are D, © x © and Sp(4,M)/U(2). 

We identify three natural subgroups in Sp(4,]R) and then show that, as a result of Lemma 
14. 2[ these are essentially the only possibilities. For two of them it is convenient to define 
Sp(4, R) with respect to the symplectic form 

Ju = (o °) where J = . (4.1) 

Remark 4.3. The relation between J12 and J13 — and hence between the resulting descrip- 
tions of Sp(4, R) — is described in Appendix IM 

The subgroups come from the following three representations: 

• The irreducible 4-dimensional representation of SL(2,M) in Sp(4, R), 

pi: SL(2,M) Sp(4,R). (4.2) 

See Section [H] for a full description. 
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• The representation of SL(2,]R) x SL(2,M) given with respect to Ju by 

P2: SL(2,M) X SL(2,M) ^ Sp(4,M) 



(4.3) 



• The representation of SL(2, M) given by, 

P3 = P2 A: SL(2,M) ^ Sp(4,M), 
where A is the diagonal embedding 

SL(2,M) SL(2,M) x SL(2,M) . 



(4.4) 



Remark 4.4. Using the Kronecker produclQ, the diagonal embedding is given by 



P3 : A 



/ ® y4 with respect to J12 
A /with respect to J13 



(4.5) 



Definition 4.5. Let 



Pp(SL(2,M) X SL(2,M))/pp(SO(2) x S0(2)); 

Pa(SL(2,M))/pa(SO(2)); 

p,(SL(2,M))/p,,(SO(2)). 



With this notation, Lemma W7I\ together with the results of Wienhard et al. on tight embed- 
dings (see [3 US]) implies the following. 

Proposition 4.6. Up to isometry o/Sp(4, ]R)/U(2), the only proper tube type domains tightly 
embedded in Sp(4, M)/U(2) are Dp ~ D x D, "Da ~ D and ~ D. 

Remark 4.7. Note that ^ D is not holomorphically embedded, while the other two are. 

Proposition 14.61 is not quite sufficient for identifying the possible embedded subgroups 
since the subdomains do not uniquely determine the subgroups. Suppose that subgroups 
Gi C 6*2 C Sp(4, M), with maximal compact subgroups Hi C i/2, give rise to the same 
subdomain, i.e. are such that Gi/Hi = G2/H2. Then it is straightforward to see that 

• i/i is a normal subgroup of H2, and 

• if the Cartan decompositions for the subgroups are Qi = [)j + nXj, then rrii = m2. 
It follows that Gi is a normal subgroup of 6*2 • The next proposition is thus immediate. 

Proposition 4.8. The following subgroups are the largest that give rise to the embedded 
domains Vi,Vp, andV^ respectively: 



G'. = iVsp(4,M)(pi(SL(2,M))), 

Gp = iVsp(4,M)(p2(SL(2,M) X SL(2,M))), 

G'A = iVsp(4,^)(p3(SL(2,M))), 



Hence Theorem 14.11 implies the following result. 



see Appendix Kl 
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Proposition 4.9. Let p: vri(X) — )■ Sp(4, R) be maximal and assume that p factors through 
a proper reductive subgroup G G G. Then, up to conjugation, G is contained in one of the 
subgroups Gi, Ga and Gp. 

Note: We will sometimes use G* to denote Gi, Gp or G/\. 

Explicit calculations show that: 
Proposition 4.10. We compute that 

(1) Gp is the group generated by SL(2,M) x SL(2,M) and ^ ]. That is, with respect to 



J 12, Gp C Sp(4,M) IS 



Gp = {(^ ^ e Sp(4, M) I either y = Z = OorX = T = 0}. 

(2) Ga = 0(2) ® SL(2, M) with respect to J12. That is, with respect to J12, G^ C Sp(4, M) is 

Ga = {(1^ ?a) I^=(^ ^) GO(2)andyleSL(2,M)}. 

We defer the calculation of Gi to Section [8] where the necessary details of the irreducible 
representation are given. The result we obtain (see Proposition I8.15P is: 

Proposition 4.11. G, = SL(2,M), i.e. 

iVsp{4,M)(pi(SL(2,M))) = pi(SL(2,M)) . (4.6) 

5. Deformations of representations - main results 

5.1. Invariants of representations. Let p: vri(X) — )■ Sp(4, M) be a representation and let 
Ep be the associated fiat Sp(4, M)-bundle. Then the Toledo invariant d{p) of p is simply 
the first Chern class of the (non-fiat) U(2)-bundle obtained by a reduction of the structure 
group of Ep to the maximal compact U(2) C Sp(4, M). In terms of the Sp(4, M)-Higgs bundle 
(V,/3,7) associated to p via the non-abelian Hodge theory correspondence, we have d{p) = 
deg(\^). A representation p is said to be maximal if d{p) = 2g — 2 (cf. Proposition I3.11| ). 
Denote the subspace of maximal representations of 7^(Sp(4, R)) by TZ"^"'^. Then the non- 
abelian Hodge theory correspondence (12.21) gives a homeomorphism 

We point out that, by the results of Burger, lozzi and Wienhard |5l|6], any maximal represen- 
tation is reductive. Hence the space 7^"*"^ consists of all (isomorphism classes of) maximal 
representations. 

Definition 5.1. We denote by 71u!i,w2j "^c a,nd7l'^^^2 the subspaces oflZ^""^ corresponding 
under h5. 1\) to the subspaces M.wi,w2! -^c -^^1/2; respectively, of M."^"-^ (cf. hS. 29\) . 
[3M\) and ^EM)) ■ 

Remark 5.2. Though apparently of a holomorphic nature, the choice of a square root K'^^'^ 
of the canonical bundle of X is in fact purely topological: each such choice corresponds to 
the choice of a spin structure on the oriented topological surface S underlying X. 
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5.2. Main Theorem. With these preliminaries in place, we can state our main result. The 
proof is based on a careful analysis of G.K-Higgs bundles carried out in Sections EJ [7] and [8] 
below. 

We shall say that a Sp(4, ]R)-Higgs bundle (V,/3,7) deforms to a Sp(4, M)-Higgs bundle 
(y' , f3' , 'j') , if they belong to the same connected component of the moduli space. In other 
words, we mean continuous deformation through polystable Sp(4, M)-Higgs bundles. In the 
setting of representations, we use the analogous notion of deformation. 

Theorem 5.3. Let X be a closed Riemann surface of genus g ^ 2 and let (V,/3,7) he a 
maximal polystable SplAjWj-Higgs bundle. Then: 

(1) {y, P, 7) deforms to a polystable G^-Higgs bundle if and only if it belongs to one of the 
sub spaces Mw I, W2 or M.'^q of M"^"'^ ■ 

(2) (V,/3,7) deforms to a polystable Gp-Higgs bundle if and only if it belongs to one of the 
subspaces Mwi,w2 or of M"'"''' . 

(3) (V", /3,7) deforms to a polystable Gi-Higgs bundle if and only if it belongs to one of the 
subspaces 

(4 ) There is no proper reductive subgroup G* C Sp(4, M) such that {V, /3, 7) can be deformed 
to a G^^-Higgs bundle if and only if (V, /3,7) belongs to one of the components with 
0<c<2g-2. 

The corresponding result for surface group representations is: 

Theorem 5.4. Let S be a closed oriented surface of genus g ^ 2 and let p : tti (5) — t- Sp(4, M) 
be a maximal representation. Then: 

(1) The representation p deforms to a representation which factors through the subgroup 
Ga C Sp(4, M) if and only if it belongs to one of the subspaces lZw^^w2 or IZ^. 

(2) The representation p deforms to a representation which factors through the subgroup 
Gp C Sp(4, M) if and only if it belongs to one of the subspaces 7lwi,w2 or TZq. 

(3) The representation p deforms to a representation which factors through the subgroup 
Gi C Sp(4,M) if and only if it belongs to one of the subspaces TZ'^i/2- 

(4) There is no proper reductive subgroup C Sp(4,M) such that p can be deformed to a 
representation which factors through G=k if and only if p belongs to a component TZ^ for some 
0<c<2g-2. 



Proof of Theorems\5.3\ and\5.4\ Statements (l)-(3) of Theorem 15.31 follow from the results 



for G=i,-Higgs bundles given in Theorem 16.171 for = Ga, Theorem 17.121 for G* = Gp and 
Theorem 18.161 for G* = Gj. 

Statements (l)-(3) of Theorem 15.41 now follow immediately through the non-abelian Hodge 
theory correspondence f l5.ip . Moreover, by Proposition 14. 9^ a maximal representation which 
factors through a proper reductive subgroup must in fact factor through one of the groups 
Ga, Gp and Gj. Hence statements (l)-(3) of Theorem 15.41 imply statement (4) of the same 
Theorem. 

Finally, by the non-abelian Hodge theory correspondence ( 15. ip . statement (4) of Theo- 
rem 15.31 follows from statement (4) of Theorem 15.41 □ 

Remark 5.5. Part (4) of this theorem says that for any representation, say p : vri(X) — t- 
Sp(4, M), represented by a point in one of the components 71^, the image p(7ri(X)) in Sp(4, M) 
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is Zariski dens^. Parts (l)-(3) of the theorem say that any other representation can be 
deformed to one whose image is not Zariski dense, and describe in which subgroups the 
image p(7ri(X)) may he. 

Remark 5.6. Though (4) of Theorem 15.31 is a resuh about Sp(4, M)-Higgs bundles our proof 
depends on the correspondence with representations, since it uses Proposition 14.91 We 
expect, though, that a pure Higgs bundle proof can be given by applying the Cayley corre- 
spondence of [3] (cf. Section . 



6. Analysis of G^-Higgs bundles I: Ga-Higgs bundles 

In this section we identify the Sp(4, M)-Higgs bundles which admit a reduction of structure 
group to Ga, in the sense of Definition 12.61 

6.1. The embedding of Ga in Sp(4,M). Proposition 14.101 describes Ga as an embedded 
subgroup of Sp(4, M) (with respect to J12). As an abstract group we can identifjl^ Ga as the 
group 

Ga ^ (SL(2, R) x 0(2))/(Z/2) . (6.1) 
This has a maximal compact subgroup 

Ha ^ (S0(2) X 0(2))/(Z/2) (6.2) 
and a Cartan decomposition of its Lie algebra 

Lie(GA) ^ (so(2) © 0(2)) © m(SL(2, M)) (6.3) 

where 

m(SL(2,M)) = {(^^ G0K2,M)}. (6.4) 

Since we prefer to use J13 when describing Sp(4, M)-Higgs bundles, we need to adjust the 
embedding given in Proposition fl4.10p . Conjugation by the matrix h given in Appendix [Al 
shows that with respect to J13 the images of Ga and are 

Ga =SL(2,M)©0(2) (6.5) 

(ix fx) I = ^ ^ = (c ^ SL(2, R) } (6.6) 
Ha =S0(2) © 0(2) 

={A © X G SL(2, M) © 0(2) I A'A = I , det{A) = 1 } 

Lemma 6.1. 

(1) The Lie algebra of Ga is invariant under the Cartan involution on Sp(4, M). 

(2) Lie(GA) n"(2) = Ue{HA) where u(2) C sp(4,M) zs as m / TOP 



^We thank Anna Wienhard for suggesting this formulation of the result. 

^The map (A, B) i-^ B (g) A defines a homomorphism from SL(2,]R) x 0(2) to 0(2) ® SL(2,R) which is 
surjective and has kernel Z/2 — {±(/,/)}. 
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Remark 6.2. It follows that the Cartan involution on Sp(4, M) restricts to define a Cartan 
involution on Ga- In fact it is the Cartan involutioiiEi^orresponding to the decomposition 
(16. 3 p and we see that Ga is a reductive subgroup of Sp(4, M) (see Section [273]) . In particular, 
i^A lies in the U(2) subgroup embedded in Sp(4,]R) as in (13. 4p . 

The following computations are needed to identify the Sp(4, ]R)-Higgs bundles whose struc- 
ture group reduces to Ga- 

Proposition 6.3. (1) The complexification ofG^ is 

~ (SL(2, C) X 0(2, C))/(Z/2) . (6.7) 
(2) The complexification of Ha is isomorphic to the complex conformal group, i.e. 

~ (S0(2, C) X 0(2, C))/(Z/2) ~ C0(2, C) (6.8) 

where 

C0(2, C) = {Ae GL(2, C) | A' A = / } (e.g) 

Proof. (1) Clear. For (2) identifjlHI S0(2, C) with C* and use the homomorphism 

C* X 0(2, C) ^ C0(2, C) (6.10) 

defined by {X,A) i— )■ XA. This is surjective with kernel {±/}. □ 

It follows from (16. 7p and (16. 8p that the complexification of the Cartan decomposition (16. 3p 
is 

Lie(G^) = Ue{H^) © (6.11) 
= (so(2, C) © 0(2, C)) © m'^(SL(2, M)) 

where 

m^(SL(2, M)) = { G 0[(2, C) } . (6.12) 

The proof of Proposition 14.101 'complexifies' to show: 
Proposition 6.4. The embedding of G^ in Sp(4,C) is given by 



. I xA yA . 

A © A = With respect to J 12, 



{A,X) ^ < 



zA tA 
aX bX 
cX dX 



, ,aX bX . . ^ 

A © A = With respect to J13 



(6.13) 



where A = (^^ ts m SL(2, C) and ^ = (^^ fj ^s m 0(2, C). 

"'^'^We cannot apply Remark 12.111 directly to conclude this, because Ga is not semisimple. However, the 
explicit verification below of (|6.15p justifies our claim. 



via 



^ A-A-i A+A-i 
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These embeddings induce embeddings of Lie(G^) in sp(4, C). Let denote the image 
of m'^(SL(2, M)) under the embedding with respect to J13. It follows that we can identify 
C sp(4, C) as 



^A = {(fj ^ij) \a,beC}. (6.14) 



Remark 6.5. Comparison with the Cartan decomposition for Sp(4,]R) (see (13. lip and (13.131) ) 
confirms that, as required (cf. (12.31) and Remark [6.21) . we get 



sp(4,C)=0[(2,C)©m^ 



0A = hi 



(6.15) 



where q% = Ue{G\) and f)X = Lie(ifX)- 

A change of basis via T = | J ^ /\ transforms into 



< = {{~r i^] 1/3,7 gC}, (6.16) 



,7/ 

where the descriptions in (I6.14p and (16.160 are related by 

(3 = 2{a + ib), (6.17) 
7 = 2(a-i6). (6.18) 

6.2. The principal bundle. 

Lemma 6.6. Let V be a rank 2 vector bundle associated to a principal C0(2, C)-bundle over 
X. Fix a good cover U = {Ua} for X and suppose that V is defined by transition functions 
{QoiIb} with respect to lA. Pick {l^p G C*} and {hajs G 0(2, C)} such that 

9ap = laphap- (6.19) 

Then 

(1) the functions {/^^} define a line bundle, say L, and 

(2) L2 = det\V) 

Proof. Consider the cocycles gap-y defined by 

fi'a/37 =gal3gi3yg-ya (6.20) 

Since 5^^/37 = I and the /i^/s are orthogonal , taking gap^ga/s-y yields 

I = ill/M^yo)!- (6.21) 
This proves (1). Part (2) now follows directly from (I6.19p . □ 
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Remark 6.7. Using the description CO (2, C) = (0(2, C) x C*)/(Z/2), we can define a homo- 
morphism 

a : C0(2,C) ^ C* (6.22) 

[A,X]^X\ (6.23) 

The bundle L is the hne bundle associated to V by the representation a, i.e. if E is the 
principal C0(2, C)-bundle underlying V then 

L = Ex^C. (6.24) 

The locally defined transition data {L/j} or {ha/s} do not in general define C* or 0(2, C) 
bundles. However, if V has even degree, then we get the following decomposition. 

Lemma 6.8. Suppose V and L are as in Lemma \6. 6\ and that V has even degree. Then 
deg(L) is even and we can pick a line bundle Lq such that 

Ll = L. (6.25) 

We can then decompose V as 

V = U®Lo, (6.26) 

where U is an 0(2, C) bundle. 

Proof. Using the same notation as in the proof of the previous lemma, let Lq be defined by 
transition functions {ua/s}- By construction we have 

<p = lip . (6.27) 

Moreover, the bundle V ® L^"^ is defined by transition functions 

Vap = i—)hap . (6.28) 

But then, since ha/3 ^ 0(2, C), 

vUvap = {^)hUhap = 1. (6.29) 

Thus f/ = 1/ (g) Lq Ms an 0(2, C) bundle. □ 
Conversely, we have the following. 

Proposition 6.9. // a rank 2 vector bundle V is of the form 

V = U0Lo, (6.30) 

where U is an 0{2, C)-bundle and Lq is a line bundle, then the structure group ofV reduces 
to C0(2,C). 

Proof. The proof follows immediately from the projection (16.101) . □ 

Remark 6.10. It follows from (16.301) that the line bundle Lq must satisfy 

Ll = det{Vy . (6.31) 

Corollary 6.11. Let {V,(3,'y) be a polystable Sp{4,M.)-Higgs bundle with maximal Toledo 
invariant, i.e. with deg{V) = 2g — 2. Then the structure group ofV (or, equivalently, of the 
underlying principal GL{2, C)-bundle) reduces to C0(2,C), i.e. to H^. 
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Proof. By Proposition 13.151 we can write V = U ^ Lq, as required by Proposition 16.91 □ 



6.3. The Higgs field. By Lemma 16.61 we can always give a 'virtual' decomposition of a 
C0(2,C) bundle V as V = W" <^ Lq, where W" and Lq are 'virtual' bundles. This is an 
honest decomposition into actual bundles if deg{V) is even, and in all cases there is a line 
bundle L such that L = (Lq)"^. 

Proposition 6.12. Let V = If" ^ Lq be the vector bundle in a G^-Higgs bundle. The Higgs 
field is then a pair 7) where 

^ e H\{LlfK)) and 7 G H\{LIY^K) . (6.32) 

Proof. The Cartan decomposition of (see (16. lip ) shows that the isotropy representation 
of is given by 

Hi = C* x±i 0(2, C) ^ C* X C* 

Let Eh'^ be the principal C0(2,C) bundle underlying V. It follows from the above obser- 
vations that the bundle associated to E^i^^ by the isotropy representation, i.e. £'j:^c(m^) = 
XAd tn^, is 

EHC^{ml) = {Llf®{Ll)-\ (6.33) 
The result follows from this. □ 

Proposition 6.13. Let (V, /3,7) be an Sp{4:,M.)-Higgs bundle which admits a reduction of 
structure group to Ga ■ Then Higgs fields P and 7 have to be of the form 

/3 = (31, (6.34) 
7 = 7/. (6.35) 

Proof. This is a direct consequence of (16.161) . □ 

We can rephrase Proposition 16.131 in a frame-independent way: 

Corollary 6.14. Let (V,/3,7) be a semistable Sp{A,Wj-Higgs bundle for which the structure 
group reduces to G^- Suppose that V has a decomposition as V = U ® L where {U,qu) is 
an orthogonal bundle and L is a line bundle. Then, using S'^V = (S'^U) ® and S'^V* = 
(S'^U*) (S) L^^, the components of the Higgs field are given by 

l = qu®l ,l3 = q\j®^ 

where 

P G H%L^K), 7 G H\L-^K). 

Remark 6.15. Notice that the section 7 G H^{L~^K) must be non-zero, since otherwise 
7 = ^qu would be zero, contradicting semistability. If deg(V^) = 2g — 2 then deg(L) = g — 1 
and deg(L~^i^) = 0. It follows that in this case = K, i.e. L is a square root of K. 
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6.4. Identifying components with GA-Higgs bundles. Having characterized (jA-Higgs 
bundles, we now identify which connected components of J\yl'^°-^ contain the (jA-Higgs bun- 
dles. 

Theorem 6.16. Let (V,/3,7) be a polystable Sp{A,M.) -Higgs bundle with maximal (positive) 
Toledo invariant. If {V, /3, 7) represents a point in one of the components Ai^ with < c < 
2g — 2 or in one of the components then the structure group of {V,/3,'j) does not 

reduce to Ga- 

Proof. Let (V, (3, 7) be a polystable Sp(4, M)-Higgs bundle for which deg(l^) = 2g — 2. Then 
7 is an isomorphism and V = W ® Lq where W is an 0(2, C)-bundle and Lq = K (see 
Section 1X5]) . Suppose that the structure group reduces to Ga- Then by Corollary 16.141 and 
the remark following it, V has a second decomposition V = U ^ L with = K. Since 
the bundles in this decomposition are determined only up to a twist by a square root of the 
trivial line bundle, we can assume that L = Lq, and hence that U = W. It follows, again by 
Corollary 16.141 that (5 = ® [5 where q is the quadratic form on W and /3 G H^{LP'K). 
If wi = then V decomposes as 

V ={L® L-^) ® = jv © N-^K 

and the quadratic form on = L © L^^ is given by 

<! = {%) ■ 

It follows that 

with respect to the decomposition = © N~^K. A comparison with the form of (3 given 
in (1) and (2) of Proposition 13.25] shows that this is not possible if (V,/3,7) represents a 
point in with < c < 2^1 - 2 or A^Ji/a- □ 

Furthermore, by comparing our description of GA-Higgs bundles with the descriptions of 
minima of the Hitchin function on A^™"^, and hence with the list of connected components 
(see Section [3171) . we get: 

Theorem 6.17. The following components of A4"^°'^ contain G^-Higgs bundles: 

(1) any component in which wi 7^ 0, i.e. 

M^,,^, for any {wi,W2) G ((Z/2)'^ - {0}) x Z/2 , 

(2) the component in which wi = and ci = 0, i.e. Mq. 

Proof. We construct Sp(4, ]R)-Higgs bundles whose structure group reduces to Ga and show 
explicitly that they lie in the requisite components of _A/f™-<^^. Let ?7 be a stable 0(2, C)- 
bundle over X and let L be a square root of K. Let (^1,^2) be the first and second 
Stiefel- Whitney classes of U and let qu : U — > U* be the (symmetric) isomorphism which 
defines the orthogonal structure on U. Consider the data {V,/3,'j), in which 

• V = U®L, 

• (3 : V* — > VK is the zero map, and 

• 7 : V — > V*K is given by qu ® II, where II is the identity map on L, 
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By construction, the structure group of V reduces to CO (2, C) and the Higgs fields /3 and 
7 take values in m^. Thus (V,/3,7) defines a GA-Higgs bundle. It is polystable because the 
bundle V is stable as an CO (2, C) bundle. 

If (V,/3,7) is polystable as a (^A-Higgs bundle then it is polystable as an Sp(4, M)-Higgs 
bundle. Since deg{V) = 2deg(L) = 2g — 2, it follows (V,/3,7) lies in one of the connected 
components of _A/f™'*^. As described in Section [3.6[ the component containing (V,/3,7) is 
labeled by invariants which classify the Cayley partner of (V,/3,7). Since = K we may 
identify U as the Cayley partner. The invariants of (V,/3,7) are thus {wi,W2) if wi ^ 0. If 
wi = then U decomposes as 

U = M® M-^ 

with deg(M) ^ 0. The invariants of U are then (0,deg(M)). We observe, finally, that 
deg(M) = if f/ is polystable. □ 



7. Analysis of G*-Higgs bundles II: Gp-HiGGS bundles 
7.1. Generalities. Recall the abstract description of Gp as an extension 

{1} ^ SL(2,M) X SL(2,M) ^ Gp ^ Z/2 ^ {0}, 
in fact, a semi-direct product 

Gp = (SL(2,M) X SL(2,M)) x Z/2. 

Also, 



(7.1) 
(7.2) 



Proposition 7.1. The maximal compact subgroups, Hp C Gp, and their complexifications 
Hp are conjugate to 

Hp = (S0(2) X S0(2)) X Z/2, (7.3) 
H^ = (S0(2, C) X S0(2, C)) X Z/2 . (7.4) 

With respect to J13 the embedding fl4.3p becomes 



(A 5) 



A® 



1 





1 



(7.5) 



showing that S0(2) x S0(2) (a maximal compact subgroup of SL(2,M) x SL(2,M)) embeds 
in the choice of maximal compact subgroup of Sp(4,]R)) (i.e. U(2)) defined by (13. 4p . After 

^ ^ S/ this yields an embedding of S0(2, C) x S0(2, C) in SL(4, C) 



conjugation by T 
given by 



1 



u —V 
V u 



z —w 
w z 



fu + iv \ 

z + iw 

u-iv 

\ z — iw 



(7.6) 



Either way, since Gp is semisimple, it follows from Remark 12.111 that 



Proposition 7.2. The embedding defined in (1) of Proposition \^m\ makes Qp into a reduc- 
tive subgroup of Sp(4, M) . 
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Since the identification (17.2p induces an isomorphism of Lie algebras 

s((2,M) X s[(2,M) ^ Lie(Gp), 

we have the following result. 

Proposition 7.3. A Gp-Higgs bundle {V, (3, 7) admits a reduction of structure group to 
SL(2,]R) X SL(2,M) if and only if the bundle V admits a reduction of structure group from 
if^ to S0(2,C) X S0(2,C). □ 

Proposition 7.4. // (y,(3,'y) is an Sp{4:,'R)-Higgs bundle for which the structure group 
reduces to SL(2,M) x SL(2,M), then: 

(1) The bundle V has the form 

V = L^®L2. (7.7) 

(2) The components of the Higgs field are diagonal with respect to this decomposition, i.e. 

with Pi G H^mK) and e H^{LfK). 

Proof. For (1), apply (17. 6p to the transition functions for the S0(2, C) x S0(2,C) bundle. 
As for (2), if the structure group of the Higgs bundle reduces to a subgroup then the 
Higgs field takes vales in C m'^ where = g^/f)^, with the usual meanings for g^, ()^, 
etc. In our case , i.e. G^, = SL(2,]R) x SL(2,]R), expressed in global terms this means that /3 
must lie in 

{Ll®Ll)KcSjm\Li®L2)K (7.9) 

and 7 must lie in 

{Lf © Lf)K C Sym2(L^i © L^')K (7.10) 

□ 

Remark 7.5. Proposition 17.41 says simply that if the structure group of (y,/3,j) reduces to 
SL(2,M) X SL(2,M), then (V,/3,7) is a direct sum of SL(2, R)-Higgs bundles, i.e. 

(V^, (3, 7) = (Li, 72) © (L2, f32, 72). (7.11) 

Of course for (V, (3, 7) to be polystable as an Sp(4, ]R)-Higgs bundle, each (Lj, 7^) must be 
(poly)stable as an SL(2, ]R)-Higgs bundle (cf. Remark [3. 9p . 

7.2. Gp-Higgs versus SL(2,R) x SL(2,R). Let (V,/3,7) be a Gp-Higgs bundle. The ob- 
struction to reducing the structure group to SL(2,]R) x SL(2,R) C Gp defines an invariant 
(depending, by Proposition I7.3[ only on V) 

aV,P,j)eH\X,Z/2). (7.12) 

Let {tap} be a Cech Z/2-cocycle representing the class ^{V,(3,'j) and let 

p:X' — >X (7.13) 

be an unramified double cover defined by {tap}- Note that if ^(V^, /3,7) is non-zero then 

g' = g{X') = 2g-l. (7.14) 
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Proposition 7.6. Let V = p*V be the pull-back ofV and let f3' = p*f3 and 7' = j9*7 be the 
pull-backs of the Higgs fields. 

(1) The bundle V admits a reduction of structure group to C* x C*, i.e. we can write V 
as a sum of line bundles L[ © L'2 . 

(2) If L : X' — > X' is the involution covering the projection onto X then l*{V') = V . 

(3) Both f3' and 'j' decompose, as {f3[ (B f3'2) and (7^ ©72) respectively, with respect to the 
splitting V = L[ © L'^ . 

(4) The pull-back of Gp- Higgs bundle (V,/3,7) defines an SL(2,M) x SL(2, 'R)-Higgs bun- 
dle, namely 

p*(\/,/3,7) = (^'i,/3;,7D©(^2,/32,72) • (7.15) 

(5) // (V,/3,7) is polystable and degiV) = 2g — 2, i.e. if (V, /3,7) represents a point in 
f^max^ t/ien in {V',l3',y) we have 



deg(Li) = deg(L2) = g' - 1 = 2g - 2 . 

Proof. Parts (l)-(4) follow by construction. It follows from (2) that deg(Li) = deg(L2) 
^deg{V'). Part (5) thus follows from f l7.14p and 



deg(\/') = deg(7r*(V))= / Ci(7r*(V)) 

Jx' 



c,{V) = 2 / c,{V) = 2deg{V). 

7r*(X') Jx 



□ 



7.3. Identifying components with Gp-Higgs bundles. We now determine which com- 
ponents of Jii'^"-^ contain Higgs bundles for which the structure group reduces to Gp or to 
SL(2,M) X SL(2,]R). In the next section we consider components for which the invariant 
Wi = 0, and in section [7.3.21 we consider the case Wi 7^ 0. 

7.3.1. The case wi = 0. The invariant Wi is the first Stiefel- Whitney class of the Cayley 
partner of a maximal Sp(4, ]R)-Higgs bundle. Using the notation of Section [3l6l the connected 
components of TW™"*^^ in which Wi = are the components Ai^ (with ^ c < 2g — 2) and 
the connected components of 2^-2 (i-^- components ^^^1/2)- 

Proposition 7.7. 

(1) For all c in the range < c ^ 2g — 2 the connected components of M.^^ do not contain 
8^(4:,^) -Higgs bundles which admit a reduction of structure group to SL(2,]R) x 
SL(2,M). 

(2) The component does contain Sp{4:,M.) -Higgs bundles which admit a reduction of 
structure group to SL(2, M) x SL(2, M) — and hence to Gp. In fact the structure group 
can be reduced to the diagonally embedded SL(2,R) SL(2,]R) x SL(2,R). 

Proof. Let (y, /3,7) be a maximal Sp(4, R)-Higgs bundle. Recall that wi = means that 

V = N®N-^K, 7= (J 0)' det(r) = ir. (7.16) 
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Suppose furthermore that (V,/3,7) admits a reduction to SL(2,M) x SL(2,M). Then by 
Proposition \7A\ together with the fact that it has maximal Toledo invariant, this means 
that 

V = L,®L2, Lj = Ll = K, 7=(^JJ^. (7.17) 

For fl7.16l) and (17.171) to be compatible there must be diagonal embeddings 

N ®N-^K, u=l,2. 

This is equivalent to 

L^ = L2 = N = N-^K 

and hence 

K = Ll = Ll = N\ 

In particular, deg(A^) = — 1, i.e. 

c = deg(iV) - (^ - 1) = . (7.18) 

This proves (1). To prove (2), pick any L such that = K and construct the SL(2, M)-Higgs 
bundle (L,0,7) with ■j = 1^. Then the polystable Higgs bundle 

(L,0,7)©(L,0,7) 

proves part (2). 

□ 

Proposition 17.71 leaves open the possibility that there are Gp-Higgs bundles with wi = 
but in which the structure group does not reduce to SL(2,R) x SL(2,R). The next results 
rules out this possibility. 

Proposition 7.8. Let (V,/3,7) be a maximal Gp-Higgs bundle which does not reduce to an 
SL(2,]R) X SL{2, W)-Higgs bundle. Then, on the connected double cover 

X' Ax 

defined by the class ^{V,P,'y), there exist line bundles L'l and L'2 on X' such that 



p*V = L[(BL'2, L't = L'l = Kx', p*{l) 



1 
1 



In other words, p*(V", /3, 7) is a (maximal) Higgs bundle on X' with structure group SL(2, M) x 
SL(2,M). 

Proof. Clear. □ 

Proposition 7.9. Let (V, /3, 7) be a maximal Gp-Higgs bundle for which the structure group 
does not reduce to SL(2,]R) x SL(2,M). Assume that wi{V, P,'~f) = 0, in other words, that 
{V, (3, 7) is of the form \7.1&) . Then deg(X) = g — 1. 

Proof. Combining Propositions 17.71 and 17.81 we get that 

{p*Nf = Kx'. 

Recall, moreover, that g{X') = 2g{X) — 1 and that deg{p*N) = 2deg(X). The result now 
follows. □ 
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Corollary 7.10. None of the components M.^^ with c > contains Sp{A,'R)-Higgs bundles 
which admit a reduction of structure group to Gp. 

7.3.2. The case wi ^ 0. In this section we prove the following. 

Proposition 7.11. For all (^1,^2) G {H\X,Z/2) - {0}) x H'^{X,Z/2) the component 
■M.w^,u]2 contains Sp(4, 'R)-Higgs bundles which admit a reduction of structure group to SL(2, R) x 
SL(2,M) c Gp. 

Proof. Let (V, 7) be a Sp(4, ]R)-Higgs bundle of the form 

y = Ll e L2, Ll = Ll = K, 13 = 0, 1=(^Q I 

If we fix a square-root of K, i.e. if we pick Lq such that Lq = K, and define the Cayley 
partner W = V* <Si Lq, then we get 

W = Mi®M2 (7.19) 

with = O. Moreover, 7 defines isomorphisms 

7. : iW, ^ MT , (7.20) 

that is, Ml and M2 are 0(1, C) bundles. As such, they are determined by their first Stiefel- 
Whitney classes 

wi(Mi),wi{M2) e H\X,Z/2). 
To determine the invariants of VF, we need to calculate the total Stiefel- Whitney class 

w{Mi © M2) = 1 + Wi(Mi © M2) + W2{Mi © M2) (7.21) 

= 1 + Wi(Mi) + Wi(M2) + Wi{Mi)wi{M2). (7.22) 
In other words, we need to analyze the map 

H\X,Z/2) X H\X,Z/2) H\X,Z/2) x H^{X,Z/2) 

Using standard coordinates on H^{X,Z/2) = (Z/2)^^ we write an element in this space as 
{ol, b) = ((ai, . . . , ag), (61, . . . , bg)) . The map is then given as follows: 

(Z/2)'^ X (Z/2)'^ ^ (Z/2)'^ X Z/2, 

9 C7 23) 

{{a,b),{g!,b:))^{{a + g:,b + ^),Y,iaib[ + a[b,)). 

1=1 

One easily sees that + a'j = and bi + b'^ = imply that aj6'j + a'fii = 0. Moreover, one 
has that 

((a,6),(0,0))^((a,6),0). 

Hence it only remains to show that any element of the form ((a, 6), l) with (a^, bj) 7^ (0, 0) 
for some j is in the image of the map. It is a simple exercise to show that there exists 
((a, b), {a', b')) G (Z/2)^ x {Z/2f such that ab' + a'b = 1 and (a + a',b + b') = {aj, bj). Now 
let {a,b) be the element obtained from (a, 6) by substituting a for dj and b for bj. Moreover, 
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define (a', 6') by letting the jth entries of a' and 6' be equal to a' and 6', respectively, and 
setting the remaining entries equal to zero. Then, clearly, 

((«,&),(«',&')) ^ 

and this concludes the proof. □ 

7.4. The final tally. Combining Corollary 17. 101 and Proposition 17. 1 1 1 we get, finally, that 

Theorem 7.12. The following components of Ai^""^ contain Sp{4,M.) -Higgs bundles which 
admit a reduction of structure group to the subgroup SL(2,M) x SL(2,M) C Gp: 

• Mn„n,2, for all {wi,W2) e H\X,Z/2) - {0} x H\X,Z/2), 

In the remaining components, i.e. in Ai^ for < c < 2g — 2 and in for all choices of 

K^^"^, none of the Higgs bundles admit a reduction of structure group to Gp. □ 

8. Analysis of G^-Higgs bundles III: Gj-Higgs bundles 

8.1. The irreducible representation. The irreducible representation of SL(2,R) in 
comes from its representation on S'^R^, the third symmetric tensor power of R^. If we 
identify with the space of degree three homogeneous polynomials in two variables, 

then the representation is defined by 

Pi{(l ^^){P){x,y) = P{ax + cy,bx + dy), (8.1) 

where A = ^ ^ is in SL(2, R) and P is a degree three homogeneous polynomial in (x, y). 
We get a matrix representation (denoted by pi) if we fix a basis for S'^R^. Taking 

{x^,3x'^y,y^,3xy'^} 

as our basis for S^M."^ (thought of as the space of degree three homogeneous polynomials in 
two variables) we get 

/a3 3a^b 63 ^^^2 \ 



Pii 



a b 
c d 



a^c a^d + 2abc b'^d b'^c + 2abd 
^ 3c^d 3cd^ 



c 



\a(? b(? + 2acd bd'^ ad^ + 2bcd j 

The standard symplectic form to = dxi A dx2 on R^ induces a bilinear form on all tensor 
powers (R^)®'', as follows: 

Q{{Vi, ...,Vn), {Wi, Wn)) = u{Vi,Wi) Cu(w„, W„), 

and therefore there is also an induced bilinear form on the symmetric powers of R^ , viewed 
as subspaces S^M."^ C (R^)®". This form is symmetric when n is even and antisymmetric 
when n is odd so, in particular, gives us a symplectic form Q on S'^R^. Non- degeneracy 
follows from the fact that the kernel of the form is an SL(2, R)-submodule of an irreducible 
representation (and can of course also be seen from the explicit calculation below). 
Take the standard basis {ei, 62} of R^ and the basis 

{eijk = ei® Cj (g) Cfc I z, j, A; = 1, 2} 
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of (M2)®3_ rpj^g^ ^Yie basis {Ei, E2, E3, E^} for S^R'^, where 

-£^1 = em, 

-^2 = eii2 + ei2i + 6211, 
-E3 = 6222, 

E4 = ei22 + 6212 + 6221 

corresponds to the basis {x^,3x^y,y^,3xy'^} for S^R"^ thought of as the space of degree 
three homogeneous polynomials of degree in two variables. Calculating the matrix Jq of the 



symplectic form Q on 5* 



3113)2 



with respect to this basis one obtains: 
/ 1 \ 

^0 = 



-3 
-10 

\o 3 y 



If ad — be = 1, i.e. if A 
of {S^R^Q) , i.e. 

Notice that with 



a b 



^ j is symplectic, then pi{A) is a symplectic transformation 



Pl(A)*JoPi(A) = Jo 

/I \ 



(8.2) 







1 




we get 



1 

/iVo/l = Jl3 



Thus using J13 to define Sp(4, M), the irreducible representation is given by 



p,,{A) = h-'p,{A)h 



b^ 



y/Sac^ acP + 2bcd y/Sbd"^ bc^ + 2acd 



VScd^ 



d' 



^flc^d 



VVSa^c b^c + 2abd y/3b'^d a^d + 2abc/ 



If A e S0(2), i.e. if d = a, b = -c and a'^ + = 1, then pi3 



a —c 
c a 



lies in the copy of 



U(2) embedded in Sp(4,]R) as in f l3.4p . Moreover, with the Cartan involution as in fl3.6p the 
image of the induced embedding 



Pi3. :5[(2,M) -^5p(4,: 
is 6'-invariant, so Remark 12.111 gives us the following. 



U) 



Proposition 8.1. With Gi = pi3(SL(2, M)) defined as above and with the choices for Sp{4:, M) 
as in Section l37l\ the subgroup Gi is a reductive subgroup o/Sp(4, M). 

Remark 8.2. This embedding extends to an embedding of SL(2,C) in Sp(4, C) C SL(4, C). 
The restriction to S0(2, C) takes values in the copy of GL(2, C) embedded in SL(4, C) via 

36 



2i 2 



15) 



If we conjugate by T = ^^^^ , that is if we make a complex change of frame from 

® C to © (C^)* , the embedding of S0(2) becomes (with A -- 



a —c 
c a 



where Oo denotes the 2x2 zero matrix and 



A 



A further conjugation by 



\/3ac{ia + c) 
^/3ac(ia + c) — 2ac^ + iic^ — 2a? c] 





/ 























v^+3 




V 


H = 




(V3+3) 


» 






8 






u 

\ V3-3 


u 

(V3- 

V 


1) 










I 


4^6 + 3^3 and 


V = 2/v 


'2 + 73, yields 














/A3 








o\ 




H oT o pi3(A) o 


{HoTY 


-1 _ 











A- 




3 























, X = a + ic 



Remark 8.3. Direct computation shows that with Sp(4, C) defined by J13, conjugation by T 
or H preserves Sp(4, C) C SL(4, C). 



Definition 8.4. Let ip : SL(2, C) — > Sp(4, C) he the composite 

^{A) = {HoT)oprs{A)o{HoT)-' 
We then have a commutative diagram 

SL(2,C) Sp(4,C) 



GL(1,C) ^^^^ GL(2,C) 
where the vertical arrow on the left is given by the identification 

'A 



GL(1,C) 

and the one on the right is given by (18. 5p . 



{(0 



(8.9) 
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8.2. The embedding of Higgs bundles. We can compute the infinitesimal version of the 
embedding (!8l3|) to find the embedding of st(2,M) C sp(4,M) (using J = J13). With 



1 




/ 





1 



ho 



1 
-1 



and with H and T as above, we compute 
Lemma 8.5. 

{HT)p,,,ie-f)iHT)r' 



{HT)prs.{e + f){HT)y 



/-3 \ 

10 

3 





\ 

/O 




V-1 



-V 


3 
-100 

4 / 



3\ 

-1 



{HT)p,M{HT)-' 



/O 3\ 

3 1 

10 

yi 4 oy 



Proof. Calculation (Mathematica). 

It follows that the restriction of ip to m'^(SL(2, C)),where 



m^(SL(2,C)) = { 



X y 

y -X 



x,y eC} 



gives 



(i^r)pi3.( 



X y 
y -X 



/O 3/3\ 
003/37 
7 

\7 4/3 y 



with 



/3 
7 



X + ly 
X — iy 



□ 



We can make a further transformation so that the bottom left corner is a multiple of 
Lemma 8.6. Let 



1 

1 



s 








1 
















^.10) 



Then 



{SHT)pis* 



X y 
y -X 



){SHT)) 



-1 



7 



/o 







5(f)\ 








5(|) 


1 





1 








Vi 








/ 
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Next, we recall from Remark 13.41 (cf. |25]) that an SL(2, M)-Higgs bundles is defined by a 
triple (L, /3, 7) where L is a holomorphic line bundle, /3 7^ G H^{L^K), and 7 G H^{L~'^K). 
Let E be the principal GL(1, C)-bundle which defines L. Using the identification of GL(1, C) 
with S0(2, C) given by fl8.9p . E defines a rank two bundle L © L~^. The Higgs fields (/3,7) 
then define a bundle map 



(3 
7 



: L®L-^ {L®L-^)®K . (8.11) 



Theorem 8.7. Let 



pi3:SL(2,M)^Sp(4,M) 

be the irreducible representation as in i\8.3\) . and let 

<f : SL(2,C) Sp(4, C) 

be the resulting representation as in ( [g. 7| ). t/se ip\GL{i,c) to extend the structure group of E 
to GL(2,C) and use ^ to embed m'^(SL(2,M)) m m'^(Sp(4,M)) (cf / fOD ) . Let 

p,^ :7W(SL(2,M)) ^7W(Sp(4,M)) (8.12) 

be the induced map from the moduli space of SL{2,M.)- Higgs bundles to the moduli space of 
Sp{4:,M.) -Higgs bundles . Let (L,/3,7) be a poly stable SL{2, 'R)-Higgs bundle. Then: 
(a)IfO^ deg(L) ^ ^ - 1 then 

pf,([L,/3,7]) = ([L3©L-\/3,7]) (8.13) 

where 



v3/3 7 y V 7 4/3 

(b) If deg(L) = g — 1 then = K and /3 and 7 can be put in the form 



l\ , ,Y/3i M J/33 = 5(f) 



Remark 8.8. The fact that the Higgs bundles obtained in (a) of Theorem 18.71 are not of the 
standard form given in Proposition 13.251 is due to the fact that unless deg(L) = g — 1 the 
Higgs bundles are not maximal, i.e. do not lie in _A/f™-'^^. 

Proof. We use local trivializations and transition functions to describe all bundle data. Fix 
an open cover {Ui} for X and local trivializations for L and K, with transition functions 

kj.hj : UiHUj — > GL(1,C) 

on non-empty intersections Ui fl Uj. Let the local descriptions of /3 and 7 over Ui be Pi and 
7j respectively. Then on non-empty intersections Ui fl Uj 

^JM.=4- (8-16) 

Similarly 

^.f^..7,=7, • (8.17) 
Observe that if = i^, so that If,- = kij, this implies 



7j = 7i • 
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The embedding of tlie SL(2, M)-Higgs bundle (L,/3,7) in tlie space of Sp(4, M)-Higgs 
bundle£l is obtained by applying ip to T^^ ^^i^ T and T,where T = 



1 i 
1 -i 



. We find 













o\ 





























\^ 





nj 





























7i 










4/3i 





0/ 



9ij 



It follows from this that {gij} define a bundle V ®V* with V = Li^ ® and that with 
respect to this decomposition {<l>j} define a Higgs field $ with (3 and 7 as in fl8.14p . It 
remains to show that the resulting Sp(4, M)-Higgs bundle, i.e. (L^ © /3, 7), is polystable 
and thus defines a point in A^(Sp(4,M)). 

Notice that if deg(L) > and {L, f3,^) is a polystable SL(2, M)-Higgs bundle, then 7 7^ 
(cf. Remark 13.91) . Thus both /3 and 7 are non-zero. It follows that {L^ © L~^, /3, 7) is stable 
if and only if the strict versions of the conditions (3a-c) of Proposition 13.51 are satisfied 
by line subbundles L' G (B L~^. But for any such line subbundle, either L' = or 
deg(L') ^ deg(L"^) < 0. Conditions (3a-c) are thus clearly satisfied if L' ^ L^. If L' = L'^ 
and /3,7 are as in fl8.14p then /3 fails to satisfy the hypotheses in (a) and (c). Moreover, 7 
satisfies the hypothesis in (b) only if 7 = 0, which is not possible if (L,/3,7) is polystable. 
Thus is not a destabilizing subbundle and we conclude that (L^ © L~^, f3, 7) is stable. 

Finally, if deg(L) = then (see Remark 13.91) either /3 = 7 = or both /3 and 7 are 
non-zero. In the former case, clearly (L^ © L~^, /9, 7) is polystable. In the latter case, clearly 
the conditions on /3 and 7 in (3b-c) of Proposition 13.51 are never satisfied by line subbundles 
L' G (B L~^. The only V G Li^ ® for which the condition on 7 in (3a) of Proposition 
13.51 is satisfied is V = L^. But then the condition on /3 in (3a) of Proposition 13.51 is not 
satisfied and we conclude that {L^ © L~^,/3,7) is stable. This completes the proof of part 
(a). 

Suppose now that deg(L) = g — 1. It follows from the definition of polystability for 
SL(2, M)-Higgs bundles that = K and 7 7^ 0. By (18.181) we can then assume that the 7^ 
are nowhere zero. We exploit this to define an automorphism of V which puts 7 in a more 



l^To be precise, this yields an SL(4, C)-Higgs bundle of the form {V (SV*, $) with "I> = ( ^ ^ ) • ^he 



7 



Sp(4, R)-Higgs bundle is defined by the data (V,/3,7). 

40 



standard form. In the local trivialization over Ui, define 



S,. 



(l 





7i 

1 






1 







-2 



.19) 



Observe that, because of ( 18.16P and (IS.lSp we get gijSjg^j^ = Si, which verifies that the {Si} 
define a bundle automorphism. But 






\7. 






li 





16^ 






li 





A 



(8.20) 



Thus the Sp(4, M)-Higgs bundle defined by (y,/3,'y) is isomorphic to the Sp(4, M)-Higgs 
bundle defined by (V, (3', 7') where /3' and 7' are as in the statement of the theorem. □ 

Corollary 8.9. Let (V,/3,7) be the image of{L,l3,'j) under (p. 

(1) The degree of V is deg{V) = 2deg(L). 

(2) If L'^ = K then (V, /3,7) lies in the component Mj^ of M""^"^ . 

Proof. Part (1) follows immediately from the fact that V = L"^ (B L~^. For (2), defining 
N = yields V = N(BN~^K with deg(A^) = 3g—3. This, together with the characterization 
of Ml 1/2 in Proposition 13^251 yields the result. □ 

Corollary 8.10. Let (V,/3,7) represent a Sp(4,]R) Higgs bundles in o,i^d suppose 

that it admits a reduction of structure group to SL(2,M). Then (V,/3,7) is isomorphic to a 
Sp{4:,R) -Higgs bundle with V = K^^^ © K~^/^ and (3 and 7 as in Theorem \8. 7[ 

8.3. The normalizer of SL(2, M). Next we calculate the normalizer of SL(2, M) embedded 
in Sp(4,M) via the irreducible representational We shall need the following standard fact. 



Proposition 8.11. The outer automorphism group o/SL(2, 
gation by the matrix ( ? J ) • 



is Z/2, generated by conju- 



Consider the extension of the irreducible representation pi to a representation in SL(4, M). 
Note that the domain of pi can be extended to SL-|-(2,M) = {A \ det(y4) = ±1}: in fact, 
substituting ( " d ) by ( % ) in (18. ip we obtain 



1 

1 



/o 





1 


o\ 











1 


1 











\p 


1 





V 



(8.21] 



which has determinant 1. 
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We are grateful to Bill Goldman for explaining this to us. 
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Next we make a general observation. Let G C G be a Lie subgroup. We have the following 
diagram of exact sequences of groups: 

1 1 1 



1 y Z{G) y G > Inn(G') y 1 

1 > GciG) ¥ NaiG) > Aut(G) (8.22) 

1 > Gg{G)/Z{G) y Ng{G)/G > Out(G) 

1 



Proposition 8.12. Let G = pi(SL(2,M)) C G = SL(4, M). Then we have a short exact 
sequence of groups: 

1 ^ Cg(G)/Z(G) ^ Ng{G)/G ^ Z/2 ^ 1, 

where the quotient Z/2 is generated by the image of pi{{ \ o)) ^ Ng{G). 

Proof. As observed above, Pi((i J)) is an element of G. Now Proposition 18.111 implies that 
this element belongs to Ng{G) and that the map on the right in the bottom row of (I8.22p is 
surjective. □ 

Proposition 8.13. Let G = pi(SL(2,M)) C G = SL(4,M). The centralizer of G m G equals 
the centre {±/} of G. 

Proof. Any element in the centralizer of G is also in the centralizer of its complexification. 
Since this complexification is just the 4-dimensional irreducible representation of SL(2, C), 
Schur's Lemma implies that any element centralizing G is a complex multiple of the identity. 
But the only multiples of the identity in SL(4, M) are ±J. □ 

Corollary 8.14. The normalizer of G = pi(SL(2,M)) in SL(4, M) fits in the short exact 
sequence of groups 

l^G'^ArsL(4,M)(G)^Z/2^1, 

where the quotient Z/2 is generated by the image pi((i o)) ^ A'sl(4,r) (G) . 

Proof. Immediate from Propositions 18.121 and 18.131 □ 

Proposition 8.15. Let G = pi(SL(2,M)) C Sp(4,M). Then the normalizer of G m Sp(4,M), 
i.e. Gi, coincides with G: 

Gi = Ai'sp(4,R) (G) = G. 
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Proof. Consider iVsp(4,M(G') C Sp(4,M) C SL(4,M) as a subgroup of SL(4,M). Clearly, 

G C Arsp(4,R(G) C NsLiMG)- 

We conclude from Corollary 18 . 141 that either A^sp(4,r(G) coincides with the index 2 subgroup 
G C A^sl(4,ir(G') or it equals iVsL(4,M(G). In the latter case, we must have pi((io)) G 
-^Sp(4,r(G')- But from (18.221) one easily checks that pi((i o)) does not satisfy (18.21) and hence 
does not belong to Sp(4,M). This concludes the proof. □ 

8.4. Summary. Putting together Theorem 18.71 , Corollary 18.91 and the fact that Gi = 
SL(2,M), we finally obtain: 

Theorem 8.16. A maximal polystable Sp{4:,M.)-Higgs bundle deforms to a polystable Gi- 
Higgs bundle if and only if it belongs to one of the Hitchin components ■ 

9. The case 3 

In this section we make a digression to the case of n ^ 3, showing that in this case any 
maximal polystable Sp(2n, M)-Higgs bundle can be deformed to a G-Higgs bundle for some 
proper reductive Zariski closed subgroup G C Sp(2r2,]R). 

9.1. The moduli space of Sp(2n, M)-Higgs bundles. An Sp(2n, ]R)-Higgs bundle on X 
(cf. Remark 13. 4 p is a triple (V,/3,7), where is a rank n holomorphic vector bundle on 
X, /3 e H\X,S^V ® K) and 7 G ff°(X,^V* ® K). The moduli space of polystable 
Sp{2n,'R)-Higgs bundles is denoted by A^(Sp(2n, M)) and is homeomorphic to the moduli 
space 7^(Sp(2n, R)) of reductive representations of vri(X) in Sp(2n, R). 

The Milnor-Wood inequality for a Sp(2?2, M)-Higgs bundle says that |deg(V^)| ^ n{g — 1). 
The moduli space of maximal Sp{2n,M^)-Higgs bundles is 

7W™""(Sp(2n,M)) = {[V,f3,-f] eM{Sp{2n,R)) \ deg{V)=n}. 

The space A^'""^(Sp(2n, M)) is homeomorphic to the moduli space of maximal representa- 
tions of 7ri(X) in Sp(2n,M). 

For any maximal Sp(2n, M)-Higgs bundle (V, /3, 7), the map 7: V V* ^ K is an isomor- 
phism and (V, (3, 7) has a Cayley partner {W, qw, 0) defined as in (I3.19p -f l3.2ip . This leads to 
the existence of invariants Wi(V,/3,7) G H^{X,Z/2) and W2{V,P,'y) G H'^{X,Z/2) defined 
by the Stiefel- Whitney classes of iW,qw) (cf. [T3]). 

The count of connected components of Ai"^"'^{Sp{2n, M) was carried out in [L5\, where the 
following theorem is proved. 

Theorem 9.1. The moduli space of maximal Sp{2n,M.)-Higgs bundles has 3 ■ 2^^ connected 
components: 

(1) For each {wi,W2) G H^{X,'Z/2) x if^(X, Z/2) there is a component Aiw-i^^w2- ^n^U 
Sp(2n, M.)-Higgs bundle {V, /3, 7) in such a component has invariants (wi, W2) and can 
be deformed to one with /3 = 0. 

(2) For each choice of a square root K^^"^ of the canonical bundle of X, there is a Hitchin 
component Any Sp{2n,'R)-Higgs bundle (V,/3,7) in such a component has 
(3^0 and can be deformed to a pi{SL{2,'R))-Higgs bundle, where pi: SL(2,M) — 
Sp(2n, M) is the irreducible representation. 
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Remark 9.2. An Sp(2n, M)-Higgs bundle in M.wi,w2 has invariants {wi, W2), and an Sp(2n, M)- 
Higgs bundle in has W2 = 0. See |15l Proposition 8.2] for the value of wi. 

Maximal Sp(2n, M)-Higgs bundles can be constructed as follows (cf. Proposition I7.4p . Let 
{Vi, Pi, 7j) be maximal polystable Sp(2nj, M)-Higgs bundles for i = 1,2 and let n = rii + n2. 
Then the polystable Sp(2n, ]R)-Higgs bundle (V, /3,7) defined by 



is maximal. Of course, such an Sp(2n, M)-Higgs bundle admits a reduction of structure group 
to Sp(2ni,M) X Sp(2n2,M). 

Proposition 9.3. Let n ^ 3. 

(1) Let (wi,W2) e H\X,'L/2) x H^{X,Z/2) he different from (0,1). Then there is a 
maximal Sp{2n,M.)-Higgs bundle which represents a point in A^i„^,«,2 and admits a reduction 
of structure group to SL(2, M) x . . . x SL(2, M) (n copies). 

(2) There is a maximal Sp{2n,M.)-Higgs bundle which represents a point in A^o,i '^i^'d 
admits a reduction of structure group to Sp(4, M) x SL(2,]R) x . . . x SL(2,M) (n — 2 copies 



Proof. (1) This follows by first using the construction in the proof of Proposition 17.111 to 
obtain a maximal polystable SL(2, M) x . . . x SL(2, M)-Higgs bundle with the required {wi, W2) 
and then taking direct sums with n — 2 copies of a maximal polystable SL(2, M)-Higgs 
bundle with wi = 0. The Sp(2n, M)-Higgs bundle (V,/3,7) thus obtained is maximal and 
has invariants (^1,^2)- Moreover (V, /3,7) is strictly polystable. Since any Sp(2n, M)-Higgs 
bundle in a Hitchin component is strictly stable [151 I2S], /9,7) does not he in such a 
component and it follows that (V,/3,7) represents a point in Mwi,w2 as required. 

(2) Take a maximal polystable Sp(4, M)-Higgs bundle with invariants (^1,^2) = (0,1) 
(existence follows from Proposition I3.29p and take direct sums of this with n — 2 copies of a 
maximal polystable SL(2, M)-Higgs bundle with wi = 0. As in the proof of (1), we see that 
this yields a maximal Sp(2n, M)-Higgs bundle with the required properties. □ 

We already knew that maximal Sp(2n, M)-Higgs bundles in the Hitchin components can 
always be deformed to G"-Higgs bundles for some proper Zariski closed subgroup G' C 
Sp(2n, M) (namely G' = SL(2,M), embedded via the irreducible representation); Proposi- 
tion 19.31 tells us that the same is true for Sp(2n, M)-Higgs bundles in all other maximal 
components. Thus the non-abelian Hodge theory correspondence gives the following. 

Corollary 9.4. Let n ^ 3. Then any maximal representation of 7Ti{S) in Sp(2n, M) can be 
deformed to one which factors through a proper reductive Zariski closed subgroup o/Sp(2n, M). 



If A is an m X m matrix with entries aij and 5 is an n x n matrix with entries bij, then 
the Kronecker product A ® B is defined to be the mn x mn matrix with block entries 
aijB. Thus if A and B are both 2x2 matrices, then 



V = Vi®V2, (3 = + (32, and 7 = 71 + 72 



o/SL(2,M);. 



Appendix A. The Kronecker product 




(A.l) 
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Several formulae in the main body of this paper have convenient forms when expressed in 
terms of this product. In particular the symplectic forms used to define Sp(4,]R) are given 
by 

Ji3 = J ® /, 
Jl2 = / ® J- 

We record some elementary but useful properties of the Kronecker product. 
Lemma A.l. Let A,C be m x m matrices and B,D be n x n matrices. Then 

{A ® B){C ® D) = AC ® BD 
{A ® B f = A^®B^ 

exp(A ® In + Im® B) = exp(v4) ® exp{B) 
If A and B are both 2x2 matrices and 



h = h' = h-^ 



(I 








o\ 








1 








1 
















V 



then 



(A.2) 
(A.3) 



(A.4) 



(A.5) 



A®B = h\B®A)h. (A.6) 

Applying (IA.6P to J13 we see that 

/iJi2 = Ji^h. (A.7) 
It follows that g G SL(4,M) satisfies g^JuQ = J12 if and only if g' = hgh satisfies g'^Jisg' = 
J13. Thus the descriptions of Sp(4, R) with respect to J12 and with respect to J13 are related 
by conjugation with h. 



Appendix B. Tables 
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Component 


Higgs bundle (V, /3, 7) 


Wi 


deg(iVi^-V2) 


W2 




Number 




V = K^/^ © K-^ 





2^-2 









(c = deg{NK-'^/^)) 


V^N® N~^K , g-K deg(N) <Sg-S 





2^-3 
c 
1 


c mod 2 




(2<7 - 3) 




V^N® N-^K , deg(N) ^g-1 











G'a) Gp 


1 


•^^Wl ,W2 

wi e H^{X,Z/2)-{0} 
W2 eH^iX,Z/2) =Z/2 


V = W(^Lo , Ll = K 
l^qw®lLo, H%Sym'{V) ® K) 


Wi 




or 1 


Ga, Gp 


2.(22ff - 1) 


TOTAL 












3.2^9 + 2t/ - 4 



Table 1. Higgs bundles in the components of A^™"^. The columns show the form of the Higgs bundles, their 
topological invariants (when applicable) , the subgroups to which the structure group of the Higgs bundles can 
reduce, and the number of connected components of each type. 





V 


/3 


7 


Gi 


i^3/2 ^ ^-1/2 


V/33 


1; ^ |/3i=const(/33)' 


C i) 


Ga 


U orthogonal 




7 e H\L-^K) 


SL(2,M) X SL(2,M) 






hi o\ 


Gp 


= Li©L2 

p:X'^X 
2:1 







Table 2. G*-Higgs bundles in A^™"^, showing the special form of the defining data {V,/3,^) for a Sp(4 
Higgs bundle which admits a reduction of structure group to the indicated subgroup. 
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